-- Logs begin at Tue 2022-08-02 20:40:23 UTC, end at Tue 2022-08-02 22:04:28 UTC. -- Aug 02 21:25:35.179993 dv-cinder-851449-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 02 21:25:35.187331 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 02 21:25:35.189370 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 21:25:35 2022] *** Aug 02 21:25:35.189370 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 21:25:35.189370 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 21:25:35.189370 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: nodename: dv-cinder-851449-4-iscsi Aug 02 21:25:35.189370 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: machine: x86_64 Aug 02 21:25:35.189370 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: clock source: unix Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: pcre jit disabled Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: detected number of CPU cores: 4 Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: current working directory: / Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: detected binary path: /usr/bin/uwsgi-core Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: your processes number limit is 47680 Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: your memory page size is 4096 bytes Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: detected max file descriptor number: 2048 Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: lock engine: pthread robust mutexes Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: thunder lock: enabled Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 02 21:25:35.189812 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 21:25:35.230707 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: Python main interpreter initialized at 0x55d40fcfa9c0 Aug 02 21:25:35.230707 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: python threads support enabled Aug 02 21:25:35.230707 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: your server socket listen backlog is limited to 100 connections Aug 02 21:25:35.230707 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: your mercy for graceful operations on workers is 90 seconds Aug 02 21:25:35.231093 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 21:25:35.231190 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: *** Operational MODE: preforking *** Aug 02 21:25:35.231468 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: *** uWSGI is running in multiple interpreter mode *** Aug 02 21:25:35.231468 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: spawned uWSGI master process (pid: 80421) Aug 02 21:25:35.231672 dv-cinder-851449-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 02 21:25:35.233435 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: spawned uWSGI worker 1 (pid: 80434, cores: 1) Aug 02 21:25:35.233435 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: spawned uWSGI worker 2 (pid: 80435, cores: 1) Aug 02 21:25:35.233435 dv-cinder-851449-4-iscsi devstack@keystone.service[80421]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 21:25:40.761358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:25:40.761358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: from cryptography.utils import int_from_bytes Aug 02 21:25:40.762143 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:25:40.762143 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: from cryptography.utils import int_from_bytes Aug 02 21:25:40.762734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:25:40.762734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: from cryptography.utils import int_from_bytes Aug 02 21:25:40.763183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:25:40.763183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: from cryptography.utils import int_from_bytes Aug 02 21:25:40.811965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 21:25:40.812182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 21:25:40.812377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] command line args: [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 21:25:40.812644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 21:25:40.812822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ================================================================================ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 21:25:40.812908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 21:25:40.813061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 21:25:40.813146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] admin_token = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.813255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] command line args: [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 21:25:40.813342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] config_dir = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.813477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.813552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 21:25:40.813639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] config_source = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.813711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ================================================================================ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 21:25:40.813819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] debug = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.813931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] admin_token = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] config_dir = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814407 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] config_source = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] debug = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.814994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] log_config_append = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] log_dir = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] log_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.815999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.816084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.816234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] log_config_append = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.816359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.816458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.816533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] log_dir = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.816595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.816704 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] log_file = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.816839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.816927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817823 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.817971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.818113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.818244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.818335 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.818453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.818553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.818683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.818766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.818913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.819032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.819140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.819280 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.819356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.819596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.819725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.819844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.819921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] publish_errors = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.820117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.820233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.820369 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.820546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.820681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.820797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.820880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] publish_errors = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] standard_threads = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.821981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] use_journal = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] standard_threads = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] use_json = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] use_stderr = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] use_syslog = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.822963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] use_journal = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.823051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.823123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] use_json = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.823192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.823299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] use_stderr = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.823448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.823525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] use_syslog = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.823683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.823767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:25:40.823930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.824013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.824184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.824267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.824431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.824517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.824665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.824743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.824909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.824992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.825146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.825224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.825391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.825467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.825622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.825700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.825864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.825942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.826096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.826173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.826342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.826417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.826574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.826651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.826807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.826883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.827046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.827123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.827296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.827374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.827538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.827615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.827771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.827853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.828020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.828098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.828299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.828377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.828547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.828630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.828786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.828870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.829013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.829095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.829248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.829336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.829539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.829623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.829694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.829769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.829930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.830016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.830176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.830263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.830405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.830482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.830635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.830769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.830879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.830957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.831125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.831201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.831356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.831487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.831588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.831664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.831818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.831895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.832048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.832165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.832301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.832379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.832530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.832607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.832757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.832911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.832984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.833054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.833199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.833276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.833429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.833515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.833660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.833736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.833887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.833962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.834117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.834200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.834344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.834420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.834576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.834653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.834954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835280 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.835955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.836070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.836243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.836332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.836405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.836481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.836611 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.836695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.836915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.836999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.837193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.837272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.837433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.837512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.837666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.837746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.837919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.838002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.838153 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.838234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.838384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.838463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.838616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.838695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.838850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.838932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.839103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.839182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.839337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.839457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.839576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.839814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.839891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.840083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.840230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.840349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.840427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.840582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.840661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.840816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.840906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.841057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.841135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.841290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.841367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.841524 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.841609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.841761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.841838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.841994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.842072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.842229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.842314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.842460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.842537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.842694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.842772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.842926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.843015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.843161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.843238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.843399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.843476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.843633 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.843719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.843869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.843947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.844107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.844245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.844361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.844519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.844594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.844663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.844815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.844894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.845043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.845134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.845271 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.845362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.845498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.845583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.845728 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.845806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.845955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.846044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.846184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.846261 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.846413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.846490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.846643 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.846722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.846878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.846961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.847112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.847195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.847363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.847443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.847597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.847681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.847828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.external = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.847907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.848056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.848173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.848351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.848429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.848587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.external = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.848667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.848814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.password = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.848901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.849050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] auth.token = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.849131 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.849288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.849374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.849520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.849599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.password = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.849764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.849844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] auth.token = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.849993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.850072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.850226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.850304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.850470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.850549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.850697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.850777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.850931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.851012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.851175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.851257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.851403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.851481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.851639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.851725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.851875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.851958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.852116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.852229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.852866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.852952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.853124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.853209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.853371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.853450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.853607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.853873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.853960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.854131 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.854217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.854370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.854450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.854625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.854712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.854907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.854986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.855146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.855223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.855405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.855493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.855639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.855718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.855873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.855953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.856117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.856264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.856381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.856460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.856621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.856698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.856866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.856954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.857101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.857180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.857349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.857426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.857582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.857672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.857834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.857914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.858068 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.858146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.858311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.858397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.858542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.858621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.858786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.858872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.859020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.859095 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.859250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.859329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.859488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.859568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.859723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.859802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.859950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.860027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.860208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.860291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.860443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.860522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.860682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.860761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.860905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.860998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.861132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.861213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.861360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.861439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.861601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.861680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.861830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.861909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.862075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.862154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.862323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.862409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.862565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.862644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.862821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.862905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.863056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.863134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.863290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.863370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.863516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.863595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.863751 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.863829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.863979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.864059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.864233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.864316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.864468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.864546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.864701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.864780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.864939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.865017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.865167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.865246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.865411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.865491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.865642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.865721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.865874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.865951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.866117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.866197 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.866353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.866433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.866577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.866654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.866812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.866893 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.867040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.867119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.867274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.867353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.867503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.867582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.867736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.867814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.867970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.868668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.868767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.868843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.869018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.869097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.869258 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.869338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.869495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.869574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.869725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.869805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.869969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.870056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.870203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.870283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.870433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.870511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.870665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.870752 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.870898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.870977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.871127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.871217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.871359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.871447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.871593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.871673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.871827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.871912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.872073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.872194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.872333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.872412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.872574 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.872652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.872808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.872896 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.873036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.873117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.873268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.873348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.873498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.873585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.873729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.873808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.873958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.874038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.874194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.874286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.874426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.874506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.874665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.874743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.874910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.875017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.875162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.875266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.875410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.875489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.875656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.875744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.875888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.875967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.876151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.876234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.876393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.876484 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.876632 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.876711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.876869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.876948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.877112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.877218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.877348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.877467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.877600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.877717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.877830 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.877957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.878072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.878212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.878290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.878444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.878523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.878691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.878771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.878928 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.879006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.879162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.879241 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.879401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.879482 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.879640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.879717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.879875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.879953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.880105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.880253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.880374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.880463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.880605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.880683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.880853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.880934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.881098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.881176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.881327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.881413 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.881572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.881653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.881806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.881885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.882042 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.882120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.882270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] role.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.882344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.882499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] role.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.882579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.882725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.882810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.882962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] role.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.883041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.883202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.883280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] role.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.883430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.883516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.883702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.883786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.883951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.884029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.884221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.884317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.884465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.884542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.884710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.884788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.884936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.885022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.885179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.885258 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.885423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.885502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.885652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.885741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.885897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.885976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.886142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.886296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.886374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.886533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.886613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.886784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.887009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.887087 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.887245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.887332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.887499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.887578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.887729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.887807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.887980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.888067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.888249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.888330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.888486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.888564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.888713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.888792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.888942 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.889021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.889170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.889249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.889422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.889500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.889656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.889735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.889888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.889974 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.890118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.890197 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.890348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.890427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.890575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.890653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.890806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] token.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.890886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.891037 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.891115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.891272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.891349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.891502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.891580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] token.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.891735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.891812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.891983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.892062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.893963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894080 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.894971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.895106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.895242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.895377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.895503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.895630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.895756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.895883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.896016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.896173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.896323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.896448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.896571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.896695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.896817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.896939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.897069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.897192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.897316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.897438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.897561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.897683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.897814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.897937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.898069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.898191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.898314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.898437 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.898569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.898691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.898814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.898937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80435) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 21:25:40.899957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.899957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:25:40.900481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80434) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 21:25:40.930046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.930291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.930501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.932943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.933177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.933406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.939377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.941730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.969158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.969366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.970937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:40.971171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.022194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.022316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.073170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.073311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.073383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.073474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.137995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.138223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.138444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.138532 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.138660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.138743 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.138878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.138961 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.139091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.139172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.139305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.139519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.162808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.163041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.163273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.163372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.163504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.163621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.163704 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.163780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.163922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.164008 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.164153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.164238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.164399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.164610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.176022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.176122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.188825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.188970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.189056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.189204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.189287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.189433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.189516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.189650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.189740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.189857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.189939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.190063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80435) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.190145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.190275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80434) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:25:41.207296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.207504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 21:25:41.207587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.207773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 21:25:41.207855 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.208018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 21:25:41.208099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.208309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.208392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 21:25:41.208573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.208666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.208826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.208907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.209074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.209152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.209324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.219200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.219422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.219506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.219693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.219775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.219959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.220041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.220267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.226895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.227138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.232121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.232413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.232497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.232691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.232771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.232968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.233060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.233242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.233321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.233497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.233578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.233756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.233836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.234017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.234105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.234282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.234369 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.234546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.234624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.234809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.234886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.235067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.257746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.258139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.259264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.259542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.259624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.259899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.264164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.264446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.264530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.264723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.264817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.265024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.271264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.271548 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.271636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.271871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.276242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.276494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.276578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.276773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.276853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.277052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.277135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.277325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.277407 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.277592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.277680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.277859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.277940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.278128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.278209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.278393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.294930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.295113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.295196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.295387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.299135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.299300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.302287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.302459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.302596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.302747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.307016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.307136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.310234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.310319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.313441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.313537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.313738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.313820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.314030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.314112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.314304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.314385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.314576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.314659 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.314857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.314946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.330829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.330923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.331110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.331192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.331372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.331467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.331629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.331711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.339032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.339125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.340631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.340905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.341022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.341178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.343711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.343984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.344077 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.344284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.344366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.344590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.344829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.344924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.345121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.345399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.356944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.357222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.357361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.357499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.357635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.357776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.357908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.358054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.358180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.358337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.358457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.358619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.358727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.359010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.374320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.375045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.377300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.378014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.380254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.380978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.382694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.383403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.384766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.385044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.385324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.385491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.385772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.386047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.391813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.392527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.393431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.394104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.396394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.396682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.396963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.397044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.397237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.397319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.397569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.397845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.406155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.406443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.406723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.407090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.407371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.407645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.413588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80434) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.413867 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.414146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.414432 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.414513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80435) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:25:41.414713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.414795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.415008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.415102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.415290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.415373 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.415570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.415652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.415844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.415953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.416111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.416263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.416396 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.416547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.416787 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.416868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.417064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.417143 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.417325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80434) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.417408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.417594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.417865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.418122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80435) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:25:41.451080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d40fcfa9c0 pid: 80434 (default app) Aug 02 21:25:41.451949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d40fcfa9c0 pid: 80435 (default app) Aug 02 21:25:41.454367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de13ae-4cb0-4034-83f2-ae91ae325394 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:41.454657 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de13ae-4cb0-4034-83f2-ae91ae325394 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:41.454932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de13ae-4cb0-4034-83f2-ae91ae325394 None None] PATH_INFO: `/v3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:41.459171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Tue Aug 2 21:25:41 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:25:49.049583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037dc81-b1d9-4c65-81bc-0296243a2ef5 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:49.050097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037dc81-b1d9-4c65-81bc-0296243a2ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:49.050097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037dc81-b1d9-4c65-81bc-0296243a2ef5 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:49.054446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1/2] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:25:49.059592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:49.059966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:49.060164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:49.130672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: INFO dbcounter [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] Registered counter for database keystone Aug 02 21:25:49.150654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG oslo_db.sqlalchemy.engines [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80434) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:25:49.157124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writer thread running {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:25:49.338108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG passlib.handlers.bcrypt [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80434) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 21:25:49.338461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG passlib.handlers.bcrypt [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80434) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 21:25:49.392808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:49.394428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:49.525895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 2/3] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 21:25:49.647033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037dc81-b1d9-4c65-81bc-0296243a2ef5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:49.716006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: INFO dbcounter [None req-7037dc81-b1d9-4c65-81bc-0296243a2ef5 None None] Registered counter for database keystone Aug 02 21:25:49.737298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG oslo_db.sqlalchemy.engines [None req-7037dc81-b1d9-4c65-81bc-0296243a2ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80435) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:25:49.744268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writer thread running {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:25:49.861233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037dc81-b1d9-4c65-81bc-0296243a2ef5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:49.865427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1d77d-339f-4b8b-873f-613404d5a911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:49.866062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1d77d-339f-4b8b-873f-613404d5a911 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:49.866341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1d77d-339f-4b8b-873f-613404d5a911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:49.866618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1d77d-339f-4b8b-873f-613404d5a911 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:49.875150 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1d77d-339f-4b8b-873f-613404d5a911 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:49.925927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING keystone.common.rbac_enforcer.enforcer [None req-36b1d77d-339f-4b8b-873f-613404d5a911 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 21:25:49.926217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1d77d-339f-4b8b-873f-613404d5a911 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:49.936266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 2/4] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Aug 2 21:25:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:25:49.942154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:49.956357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737629d-2e20-4373-8f90-a73aba0bb52f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:49.960664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb26117-7930-4c6d-8423-800b67aa9246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:49.961779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26117-7930-4c6d-8423-800b67aa9246 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:49.962060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26117-7930-4c6d-8423-800b67aa9246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:49.962333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb26117-7930-4c6d-8423-800b67aa9246 admin admin] PATH_INFO: `/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:49.963796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb26117-7930-4c6d-8423-800b67aa9246 admin admin] RBAC: Authorizing `identity:get_project(project_id=4a739ee2f7d746e0a37b1f7b651a505d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:50.013826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5eb26117-7930-4c6d-8423-800b67aa9246 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 21:25:50.014164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb26117-7930-4c6d-8423-800b67aa9246 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:50.018675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 3/5] 10.222.0.57 () {56 vars in 1207 bytes} [Tue Aug 2 21:25:49 2022] GET /identity/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d => generated 344 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:25:52.035809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ec6f3-8556-40f6-bfe2-b41ad1406522 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:52.036364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ec6f3-8556-40f6-bfe2-b41ad1406522 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:52.036364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ec6f3-8556-40f6-bfe2-b41ad1406522 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:52.040499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 3/6] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:25:52.045701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4728da-816c-42c1-b0c3-891a3bcf82b7 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:52.046072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4728da-816c-42c1-b0c3-891a3bcf82b7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:52.046257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4728da-816c-42c1-b0c3-891a3bcf82b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:52.065868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9c4728da-816c-42c1-b0c3-891a3bcf82b7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:52.067311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9c4728da-816c-42c1-b0c3-891a3bcf82b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:52.075556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 21:25:52.097061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ec6f3-8556-40f6-bfe2-b41ad1406522 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:52.108973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ec6f3-8556-40f6-bfe2-b41ad1406522 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:52.113116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131a0e5-6c52-415e-8ab1-0b9aa32ecc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:52.113709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131a0e5-6c52-415e-8ab1-0b9aa32ecc05 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:52.113990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131a0e5-6c52-415e-8ab1-0b9aa32ecc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:52.114262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131a0e5-6c52-415e-8ab1-0b9aa32ecc05 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:52.122105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131a0e5-6c52-415e-8ab1-0b9aa32ecc05 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:52.123852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131a0e5-6c52-415e-8ab1-0b9aa32ecc05 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:52.132722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 4/8] 10.222.0.57 () {58 vars in 1324 bytes} [Tue Aug 2 21:25:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:25:52.139431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4728da-816c-42c1-b0c3-891a3bcf82b7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:52.149991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4728da-816c-42c1-b0c3-891a3bcf82b7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:52.154399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014c210-6227-4133-8460-2b069a7d0ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:52.155033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c210-6227-4133-8460-2b069a7d0ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:52.155322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c210-6227-4133-8460-2b069a7d0ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:52.155601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014c210-6227-4133-8460-2b069a7d0ce5 admin admin] PATH_INFO: `/v3/users/26d170ed749e495e8c4adc26cb1aaae7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:52.157269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014c210-6227-4133-8460-2b069a7d0ce5 admin admin] RBAC: Authorizing `identity:get_user(user_id=26d170ed749e495e8c4adc26cb1aaae7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:52.159103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014c210-6227-4133-8460-2b069a7d0ce5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:52.160693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 5/9] 10.222.0.57 () {56 vars in 1198 bytes} [Tue Aug 2 21:25:52 2022] GET /identity/v3/users/26d170ed749e495e8c4adc26cb1aaae7 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:25:54.200864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e6bb5-81a4-448c-bf99-5674195321f3 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:54.201349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e6bb5-81a4-448c-bf99-5674195321f3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:54.201349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e6bb5-81a4-448c-bf99-5674195321f3 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:54.202675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 5/10] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:25:54.207801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc861f37-7b70-4be2-8409-2c6f527dab34 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:54.208217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc861f37-7b70-4be2-8409-2c6f527dab34 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:54.208516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc861f37-7b70-4be2-8409-2c6f527dab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:54.227819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-fc861f37-7b70-4be2-8409-2c6f527dab34 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:54.229048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fc861f37-7b70-4be2-8409-2c6f527dab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:54.239827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07caa1-fe2d-4ccd-b589-f6cacf386637 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:54.240111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07caa1-fe2d-4ccd-b589-f6cacf386637 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:54.240414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07caa1-fe2d-4ccd-b589-f6cacf386637 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:54.241763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 6/11] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:25:54.247354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466eb4d-1c75-434c-81b6-acb2b487a0d4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:54.247640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466eb4d-1c75-434c-81b6-acb2b487a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:54.247917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466eb4d-1c75-434c-81b6-acb2b487a0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:54.289132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG passlib.handlers.bcrypt [None req-c466eb4d-1c75-434c-81b6-acb2b487a0d4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80435) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 21:25:54.290239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG passlib.handlers.bcrypt [None req-c466eb4d-1c75-434c-81b6-acb2b487a0d4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80435) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 21:25:54.311812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:25:54.334003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc861f37-7b70-4be2-8409-2c6f527dab34 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:54.336399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c466eb4d-1c75-434c-81b6-acb2b487a0d4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:54.338020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c466eb4d-1c75-434c-81b6-acb2b487a0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:54.357756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:54.437557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 7/13] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:25:54.438059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc861f37-7b70-4be2-8409-2c6f527dab34 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:54.459090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466eb4d-1c75-434c-81b6-acb2b487a0d4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:54.473581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1f6f1-e2d7-41ed-bcdd-0cf285faf84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:54.474228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1f6f1-e2d7-41ed-bcdd-0cf285faf84f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:54.474508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1f6f1-e2d7-41ed-bcdd-0cf285faf84f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:54.474786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1f6f1-e2d7-41ed-bcdd-0cf285faf84f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:54.486045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1f6f1-e2d7-41ed-bcdd-0cf285faf84f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-d8f1f6f1-e2d7-41ed-bcdd-0cf285faf84f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:25:54.495699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:25:54.496606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:25:54.497600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 7/14] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:25:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:25:54.502567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1f6f1-e2d7-41ed-bcdd-0cf285faf84f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:54.558622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466eb4d-1c75-434c-81b6-acb2b487a0d4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:54.561235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:54.582828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:54.596119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6694e8b-b8dd-4650-a97e-072450e5070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:54.597019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6694e8b-b8dd-4650-a97e-072450e5070e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:54.597300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6694e8b-b8dd-4650-a97e-072450e5070e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:54.597574 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6694e8b-b8dd-4650-a97e-072450e5070e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:54.603600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1f6f1-e2d7-41ed-bcdd-0cf285faf84f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:54.636051 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33469cf-cdd4-46e1-8e54-4a84d398a937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:54.636685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33469cf-cdd4-46e1-8e54-4a84d398a937 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:54.636965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33469cf-cdd4-46e1-8e54-4a84d398a937 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:54.637243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33469cf-cdd4-46e1-8e54-4a84d398a937 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:54.637952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33469cf-cdd4-46e1-8e54-4a84d398a937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:25:54.638252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33469cf-cdd4-46e1-8e54-4a84d398a937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:54.639636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33469cf-cdd4-46e1-8e54-4a84d398a937 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:54.651624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 8/15] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:25:54.657546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33469cf-cdd4-46e1-8e54-4a84d398a937 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:54.665822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6694e8b-b8dd-4650-a97e-072450e5070e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:54.667368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6694e8b-b8dd-4650-a97e-072450e5070e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:54.765585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 21:25:54.771580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6694e8b-b8dd-4650-a97e-072450e5070e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:54.775304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:54.862869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33469cf-cdd4-46e1-8e54-4a84d398a937 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:54.877100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6694e8b-b8dd-4650-a97e-072450e5070e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:54.896383 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f9e64-eddb-453b-9b76-6dfd21c285b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:54.897025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f9e64-eddb-453b-9b76-6dfd21c285b8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:54.897303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f9e64-eddb-453b-9b76-6dfd21c285b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:54.897576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f9e64-eddb-453b-9b76-6dfd21c285b8 None admin] PATH_INFO: `/v3/users/26d170ed749e495e8c4adc26cb1aaae7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:54.899517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f9e64-eddb-453b-9b76-6dfd21c285b8 None admin] RBAC: Authorizing `identity:get_user(user_id=26d170ed749e495e8c4adc26cb1aaae7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:54.900988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f9e64-eddb-453b-9b76-6dfd21c285b8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:54.902572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 9/17] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:25:54 2022] GET /identity/v3/users/26d170ed749e495e8c4adc26cb1aaae7 => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:25:54.908354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f9e64-eddb-453b-9b76-6dfd21c285b8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:54.915978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524c693-1553-4d97-b7ea-3bca92a025c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:54.916908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524c693-1553-4d97-b7ea-3bca92a025c7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:54.917195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524c693-1553-4d97-b7ea-3bca92a025c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:54.917479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524c693-1553-4d97-b7ea-3bca92a025c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:54.922456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:54.935690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524c693-1553-4d97-b7ea-3bca92a025c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:54.937176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524c693-1553-4d97-b7ea-3bca92a025c7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1524c693-1553-4d97-b7ea-3bca92a025c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:25:54.955300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:25:54.956086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:25:54.956893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:25:54.956893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:25:54.956893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:25:54.956893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:25:54.956893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 9/18] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:25:54.962786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524c693-1553-4d97-b7ea-3bca92a025c7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:55.006664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f9e64-eddb-453b-9b76-6dfd21c285b8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:55.016933 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:55.041910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aed38-fdb9-4d76-8eef-012080bf4aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:55.042551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aed38-fdb9-4d76-8eef-012080bf4aac None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:55.042832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aed38-fdb9-4d76-8eef-012080bf4aac None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:55.043101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192aed38-fdb9-4d76-8eef-012080bf4aac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:55.044283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aed38-fdb9-4d76-8eef-012080bf4aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:55.045717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192aed38-fdb9-4d76-8eef-012080bf4aac None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:55.047288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 10/19] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:25:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:25:55.052922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aed38-fdb9-4d76-8eef-012080bf4aac None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:55.060589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524c693-1553-4d97-b7ea-3bca92a025c7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:55.093779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7e8fe-9f4d-43f1-ab77-418eaf110ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:55.094396 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7e8fe-9f4d-43f1-ab77-418eaf110ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:55.094677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7e8fe-9f4d-43f1-ab77-418eaf110ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:55.094951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7e8fe-9f4d-43f1-ab77-418eaf110ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:55.095919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7e8fe-9f4d-43f1-ab77-418eaf110ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:25:55.096267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7e8fe-9f4d-43f1-ab77-418eaf110ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:55.097653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7e8fe-9f4d-43f1-ab77-418eaf110ee5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:55.114775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 10/20] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:25:55.132266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:55.154072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192aed38-fdb9-4d76-8eef-012080bf4aac None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:55.189345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be5513-ac75-4a64-b4be-3cfcf0d621bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:55.189981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5513-ac75-4a64-b4be-3cfcf0d621bf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:55.190269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5513-ac75-4a64-b4be-3cfcf0d621bf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:55.190551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be5513-ac75-4a64-b4be-3cfcf0d621bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:55.191358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5513-ac75-4a64-b4be-3cfcf0d621bf None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.domain.id=default, user.id=26d170ed749e495e8c4adc26cb1aaae7) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:25:55.191675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5513-ac75-4a64-b4be-3cfcf0d621bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:55.193211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be5513-ac75-4a64-b4be-3cfcf0d621bf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:55.201167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 11/21] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Aug 2 21:25:55 2022] GET /identity/v3/role_assignments?user.id=26d170ed749e495e8c4adc26cb1aaae7&scope.domain.id=default&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:25:57.584185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ed28-3181-445c-9a3d-62c5b361e376 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:57.584185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ed28-3181-445c-9a3d-62c5b361e376 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:57.584185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993ed28-3181-445c-9a3d-62c5b361e376 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:57.585891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 11/22] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:25:57.592822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361ac8-4eb0-412b-84cc-38799db81152 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:57.593952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361ac8-4eb0-412b-84cc-38799db81152 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:57.594445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f361ac8-4eb0-412b-84cc-38799db81152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:57.617830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9f361ac8-4eb0-412b-84cc-38799db81152 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:57.619383 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9f361ac8-4eb0-412b-84cc-38799db81152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:57.697978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:25:57.735133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993ed28-3181-445c-9a3d-62c5b361e376 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:57.876530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993ed28-3181-445c-9a3d-62c5b361e376 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:57.881142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc182-c743-49de-8bb7-5a290d9556e2 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:57.881441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc182-c743-49de-8bb7-5a290d9556e2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:57.881723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721dc182-c743-49de-8bb7-5a290d9556e2 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:57.883865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:25:57.888501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a6dca-3916-47ae-ab90-35d44182369c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:57.888786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a6dca-3916-47ae-ab90-35d44182369c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:57.889062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a6dca-3916-47ae-ab90-35d44182369c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:57.918629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-690a6dca-3916-47ae-ab90-35d44182369c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:57.919844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-690a6dca-3916-47ae-ab90-35d44182369c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:57.930654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:57.963940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8a894-8dc7-4ce2-a1a5-af38f1520953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:57.964637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a894-8dc7-4ce2-a1a5-af38f1520953 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:57.964921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a894-8dc7-4ce2-a1a5-af38f1520953 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:57.965195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8a894-8dc7-4ce2-a1a5-af38f1520953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:57.990709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8a894-8dc7-4ce2-a1a5-af38f1520953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:57.992218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8a894-8dc7-4ce2-a1a5-af38f1520953 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-bbb8a894-8dc7-4ce2-a1a5-af38f1520953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:25:58.016902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:25:58.018058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:25:58.019127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:25:58.019127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:25:58.019127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:25:58.019127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:25:58.019319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 14/25] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:25:58.019319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af320-1140-4716-8816-bb308bb47f14 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:58.019319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af320-1140-4716-8816-bb308bb47f14 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:58.019319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660af320-1140-4716-8816-bb308bb47f14 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:58.020533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 15/26] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:25:58.021652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 12/27] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:25:58.021954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0857408-e3e0-4f9a-8588-8d1273fd99fc None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:58.022365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0857408-e3e0-4f9a-8588-8d1273fd99fc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:58.022730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0857408-e3e0-4f9a-8588-8d1273fd99fc None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:58.024620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 16/28] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:25:58.030108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0857408-e3e0-4f9a-8588-8d1273fd99fc None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:58.030495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9e176-9e89-493a-8758-ff1a42e59e56 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:58.031040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9e176-9e89-493a-8758-ff1a42e59e56 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:58.031323 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9e176-9e89-493a-8758-ff1a42e59e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:58.035536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:58.061721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cda9e176-9e89-493a-8758-ff1a42e59e56 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:58.063544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cda9e176-9e89-493a-8758-ff1a42e59e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:58.161060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0857408-e3e0-4f9a-8588-8d1273fd99fc None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:58.164994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 13/29] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:25:58.167462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cfb49-3815-463e-b6ff-b4e611d9f1a7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:58.171386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cfb49-3815-463e-b6ff-b4e611d9f1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:58.172084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cfb49-3815-463e-b6ff-b4e611d9f1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:58.200024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5a1cfb49-3815-463e-b6ff-b4e611d9f1a7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:58.201475 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5a1cfb49-3815-463e-b6ff-b4e611d9f1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:58.220707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc4109-fc74-410c-ba02-33cff1ce9f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:58.221335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc4109-fc74-410c-ba02-33cff1ce9f8f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:58.221673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc4109-fc74-410c-ba02-33cff1ce9f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:58.221953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc4109-fc74-410c-ba02-33cff1ce9f8f None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:58.223221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc4109-fc74-410c-ba02-33cff1ce9f8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:25:58.223546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc4109-fc74-410c-ba02-33cff1ce9f8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:58.225329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc4109-fc74-410c-ba02-33cff1ce9f8f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:58.250652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 17/30] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:25:58.251628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc4109-fc74-410c-ba02-33cff1ce9f8f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:58.324707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:58.370267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc4109-fc74-410c-ba02-33cff1ce9f8f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:58.388816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 14/31] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:25:58.393085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cfb49-3815-463e-b6ff-b4e611d9f1a7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:58.410948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df1b84-376d-48a9-9c7b-7d4e8531d0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:58.411639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df1b84-376d-48a9-9c7b-7d4e8531d0ac None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:58.412346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df1b84-376d-48a9-9c7b-7d4e8531d0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:58.412649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df1b84-376d-48a9-9c7b-7d4e8531d0ac None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:58.413379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df1b84-376d-48a9-9c7b-7d4e8531d0ac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:58.414811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df1b84-376d-48a9-9c7b-7d4e8531d0ac None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:58.440665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:58.524404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cfb49-3815-463e-b6ff-b4e611d9f1a7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:58.548082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 18/32] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 21:25:58 2022] POST /identity/v3/roles => generated 219 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:25:58.549246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df1b84-376d-48a9-9c7b-7d4e8531d0ac None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:58.578063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b9886-57f4-43ee-8c2c-bc11274e7281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:58.578807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b9886-57f4-43ee-8c2c-bc11274e7281 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:58.579096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b9886-57f4-43ee-8c2c-bc11274e7281 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:58.579482 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b9886-57f4-43ee-8c2c-bc11274e7281 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:58.580246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b9886-57f4-43ee-8c2c-bc11274e7281 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:58.581735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b9886-57f4-43ee-8c2c-bc11274e7281 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:58.690800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df1b84-376d-48a9-9c7b-7d4e8531d0ac None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:58.755821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:58.780374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f034e-6af6-45f0-9301-76b51dfe16b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:58.781277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f034e-6af6-45f0-9301-76b51dfe16b8 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:58.781568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f034e-6af6-45f0-9301-76b51dfe16b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:58.781852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f034e-6af6-45f0-9301-76b51dfe16b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:58.782555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f034e-6af6-45f0-9301-76b51dfe16b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:58.784972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 15/33] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 21:25:58 2022] POST /identity/v3/roles => generated 225 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:25:58.786523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b9886-57f4-43ee-8c2c-bc11274e7281 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:58.788592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f034e-6af6-45f0-9301-76b51dfe16b8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:58.890169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 19/34] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:25:58 2022] POST /identity/v3/projects => generated 301 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:25:58.928960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:58.943780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b9886-57f4-43ee-8c2c-bc11274e7281 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:58.985213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c7808-9525-4783-a23c-0bc2a8f81bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:58.985939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c7808-9525-4783-a23c-0bc2a8f81bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:58.986223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c7808-9525-4783-a23c-0bc2a8f81bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:58.986498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c7808-9525-4783-a23c-0bc2a8f81bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.001419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2c7808-9525-4783-a23c-0bc2a8f81bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9e2c7808-9525-4783-a23c-0bc2a8f81bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:25:59.009102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:25:59.009980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:25:59.010695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:25:59.012239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 16/35] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:25:59.016874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f034e-6af6-45f0-9301-76b51dfe16b8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:59.056652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cae698-d05b-4e26-8bb8-5ae4097279c8 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.057217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cae698-d05b-4e26-8bb8-5ae4097279c8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.057700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cae698-d05b-4e26-8bb8-5ae4097279c8 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.060852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 17/36] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:25:59.065517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cd86a-d9f6-4535-958c-a21aaedcc2c8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.066115 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cd86a-d9f6-4535-958c-a21aaedcc2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.066902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4cd86a-d9f6-4535-958c-a21aaedcc2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.092797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ce4cd86a-d9f6-4535-958c-a21aaedcc2c8 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:59.095630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ce4cd86a-d9f6-4535-958c-a21aaedcc2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:59.159117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f034e-6af6-45f0-9301-76b51dfe16b8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:59.187040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 18/37] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:25:59.205076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6e990-d96e-45f4-a1b9-2151ec943cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:59.205925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6e990-d96e-45f4-a1b9-2151ec943cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.206345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6e990-d96e-45f4-a1b9-2151ec943cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.206758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6e990-d96e-45f4-a1b9-2151ec943cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.207641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6e990-d96e-45f4-a1b9-2151ec943cb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:25:59.207948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6e990-d96e-45f4-a1b9-2151ec943cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:59.209822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6e990-d96e-45f4-a1b9-2151ec943cb7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:59.210286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cd86a-d9f6-4535-958c-a21aaedcc2c8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:59.220302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:25:59.226270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6e990-d96e-45f4-a1b9-2151ec943cb7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:59.270264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:59.299310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:59.321552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4cd86a-d9f6-4535-958c-a21aaedcc2c8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:59.330210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6e990-d96e-45f4-a1b9-2151ec943cb7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:59.355963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26916daf-16d4-4e63-b4b9-af5b99bdb5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:59.356643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916daf-16d4-4e63-b4b9-af5b99bdb5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.356932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916daf-16d4-4e63-b4b9-af5b99bdb5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.357214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916daf-16d4-4e63-b4b9-af5b99bdb5b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.358681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26916daf-16d4-4e63-b4b9-af5b99bdb5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:59.360304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26916daf-16d4-4e63-b4b9-af5b99bdb5b0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:59.361896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 19/39] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:25:59.363052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b43f9c-b3e1-4f91-876d-b4950ecbc462 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.363339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b43f9c-b3e1-4f91-876d-b4950ecbc462 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.363608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0a9d23-4a67-4867-a7a7-b3c547dc2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:59.363723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b43f9c-b3e1-4f91-876d-b4950ecbc462 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.364282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9d23-4a67-4867-a7a7-b3c547dc2862 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.364569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9d23-4a67-4867-a7a7-b3c547dc2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.365013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0a9d23-4a67-4867-a7a7-b3c547dc2862 None admin] PATH_INFO: `/v3/users/26d170ed749e495e8c4adc26cb1aaae7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.365116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 20/40] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:25:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:25:59.366030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a9d23-4a67-4867-a7a7-b3c547dc2862 None admin] RBAC: Authorizing `identity:get_user(user_id=26d170ed749e495e8c4adc26cb1aaae7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:59.367517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0a9d23-4a67-4867-a7a7-b3c547dc2862 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:59.373314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 21/41] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:25:59 2022] GET /identity/v3/users/26d170ed749e495e8c4adc26cb1aaae7 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:25:59.373438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b43f9c-b3e1-4f91-876d-b4950ecbc462 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:59.373540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d833-c7a8-411c-b501-8543dbafc3a3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.373540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d833-c7a8-411c-b501-8543dbafc3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.373540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6d833-c7a8-411c-b501-8543dbafc3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.388740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-83e6d833-c7a8-411c-b501-8543dbafc3a3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:25:59.390245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-83e6d833-c7a8-411c-b501-8543dbafc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:25:59.456610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 22/42] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:25:59.457381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6d833-c7a8-411c-b501-8543dbafc3a3 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:59.482992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b43f9c-b3e1-4f91-876d-b4950ecbc462 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:59.493541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:59.516288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d2507-150c-4ed0-b5c2-16dd2c1331cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:59.516906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d2507-150c-4ed0-b5c2-16dd2c1331cf None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.517186 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d2507-150c-4ed0-b5c2-16dd2c1331cf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.517461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d2507-150c-4ed0-b5c2-16dd2c1331cf None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.518137 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d2507-150c-4ed0-b5c2-16dd2c1331cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:59.519564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d2507-150c-4ed0-b5c2-16dd2c1331cf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:59.542272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:59.550338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 21/43] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:25:59 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:25:59.551139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d2507-150c-4ed0-b5c2-16dd2c1331cf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:59.573423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6d833-c7a8-411c-b501-8543dbafc3a3 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:59.611612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60936cf-7cdd-4ec9-9a8b-3ed43ba89147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:59.612307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60936cf-7cdd-4ec9-9a8b-3ed43ba89147 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.612592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60936cf-7cdd-4ec9-9a8b-3ed43ba89147 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.612874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60936cf-7cdd-4ec9-9a8b-3ed43ba89147 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.614057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60936cf-7cdd-4ec9-9a8b-3ed43ba89147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:59.615560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60936cf-7cdd-4ec9-9a8b-3ed43ba89147 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:59.617464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 23/44] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:25:59.623056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60936cf-7cdd-4ec9-9a8b-3ed43ba89147 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:25:59.666763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d2507-150c-4ed0-b5c2-16dd2c1331cf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:59.708965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e31c8-57b6-4fe4-9821-f6e329d5594a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:59.709520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e31c8-57b6-4fe4-9821-f6e329d5594a None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.710772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e31c8-57b6-4fe4-9821-f6e329d5594a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.710772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e31c8-57b6-4fe4-9821-f6e329d5594a None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.710772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e31c8-57b6-4fe4-9821-f6e329d5594a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:59.712851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e31c8-57b6-4fe4-9821-f6e329d5594a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:59.730617 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 21:25:59 2022] POST /identity/v3/roles => generated 223 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:25:59.737812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60936cf-7cdd-4ec9-9a8b-3ed43ba89147 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:25:59.742845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:25:59.780560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aabce6-ba75-44a5-8cb2-cf4e29c76e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:25:59.781533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aabce6-ba75-44a5-8cb2-cf4e29c76e4b None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:25:59.781822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aabce6-ba75-44a5-8cb2-cf4e29c76e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:25:59.782106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aabce6-ba75-44a5-8cb2-cf4e29c76e4b None admin] PATH_INFO: `/v3/domains/default/users/26d170ed749e495e8c4adc26cb1aaae7/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:25:59.784290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aabce6-ba75-44a5-8cb2-cf4e29c76e4b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=26d170ed749e495e8c4adc26cb1aaae7, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:25:59.785818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aabce6-ba75-44a5-8cb2-cf4e29c76e4b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:25:59.809785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 24/46] 10.222.0.57 () {58 vars in 1361 bytes} [Tue Aug 2 21:25:59 2022] PUT /identity/v3/domains/default/users/26d170ed749e495e8c4adc26cb1aaae7/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:26:01.605873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186f69d-62e9-4758-9701-e49b5ff67feb None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:01.606382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186f69d-62e9-4758-9701-e49b5ff67feb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:01.606483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186f69d-62e9-4758-9701-e49b5ff67feb None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:01.607803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 23/47] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:01.613074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9ef65-2579-4ee5-b34b-83e6335adfd6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:01.613482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9ef65-2579-4ee5-b34b-83e6335adfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:01.613640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9ef65-2579-4ee5-b34b-83e6335adfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:01.632553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-60c9ef65-2579-4ee5-b34b-83e6335adfd6 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:01.633787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-60c9ef65-2579-4ee5-b34b-83e6335adfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:01.699900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 25/48] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:01.721968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186f69d-62e9-4758-9701-e49b5ff67feb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:01.781865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d4485-226d-4605-a1d9-32caeeedc46b None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:01.782156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d4485-226d-4605-a1d9-32caeeedc46b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:01.782442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d4485-226d-4605-a1d9-32caeeedc46b None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:01.783844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 26/49] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:01.784530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:01.790145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09467-04ea-47c8-a637-88d635d69a40 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:01.790437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09467-04ea-47c8-a637-88d635d69a40 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:01.790716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e09467-04ea-47c8-a637-88d635d69a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:01.813286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a1e09467-04ea-47c8-a637-88d635d69a40 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:01.814509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a1e09467-04ea-47c8-a637-88d635d69a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:01.831071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186f69d-62e9-4758-9701-e49b5ff67feb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:01.865178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcded8-ddca-44c2-8a41-178407c7e448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:01.865817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcded8-ddca-44c2-8a41-178407c7e448 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:01.866105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcded8-ddca-44c2-8a41-178407c7e448 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:01.866382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcded8-ddca-44c2-8a41-178407c7e448 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:01.868091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcded8-ddca-44c2-8a41-178407c7e448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:01.869577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbcded8-ddca-44c2-8a41-178407c7e448 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:01.871164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 24/50] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:01.876650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcded8-ddca-44c2-8a41-178407c7e448 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:01.879024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 27/51] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:01.901588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09467-04ea-47c8-a637-88d635d69a40 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:01.926156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:01.974701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbcded8-ddca-44c2-8a41-178407c7e448 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:02.000040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:02.000669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e09467-04ea-47c8-a637-88d635d69a40 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:02.009297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb311af-8b75-4da1-b282-59549738f5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:02.009915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb311af-8b75-4da1-b282-59549738f5dc None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:02.010210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb311af-8b75-4da1-b282-59549738f5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:02.010483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb311af-8b75-4da1-b282-59549738f5dc None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:02.011155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb311af-8b75-4da1-b282-59549738f5dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:02.012621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb311af-8b75-4da1-b282-59549738f5dc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:02.035222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aa29b-dd71-4711-97e0-2153e791b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:02.035859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa29b-dd71-4711-97e0-2153e791b435 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:02.036157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa29b-dd71-4711-97e0-2153e791b435 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:02.036437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75aa29b-dd71-4711-97e0-2153e791b435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:02.039051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 25/52] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Aug 2 21:26:01 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:26:02.054668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75aa29b-dd71-4711-97e0-2153e791b435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c75aa29b-dd71-4711-97e0-2153e791b435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:02.060102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:02.061065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:02.061797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 28/53] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:02.067527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb311af-8b75-4da1-b282-59549738f5dc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:02.171467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb311af-8b75-4da1-b282-59549738f5dc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:02.208598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf37f8-b8a1-4ca9-91fe-572d86b6f35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:02.209224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf37f8-b8a1-4ca9-91fe-572d86b6f35c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:02.209503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf37f8-b8a1-4ca9-91fe-572d86b6f35c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:02.209779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf37f8-b8a1-4ca9-91fe-572d86b6f35c None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:02.210505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf37f8-b8a1-4ca9-91fe-572d86b6f35c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:02.211290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf37f8-b8a1-4ca9-91fe-572d86b6f35c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:02.212716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf37f8-b8a1-4ca9-91fe-572d86b6f35c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:02.224601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 26/54] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:02.231127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aa29b-dd71-4711-97e0-2153e791b435 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:02.313461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:02.329070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75aa29b-dd71-4711-97e0-2153e791b435 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:02.362374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fccc13-9c6b-4b7e-9520-d93b9c02890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:02.363016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fccc13-9c6b-4b7e-9520-d93b9c02890e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:02.363300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fccc13-9c6b-4b7e-9520-d93b9c02890e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:02.363576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fccc13-9c6b-4b7e-9520-d93b9c02890e None admin] PATH_INFO: `/v3/users/26d170ed749e495e8c4adc26cb1aaae7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:02.364768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fccc13-9c6b-4b7e-9520-d93b9c02890e None admin] RBAC: Authorizing `identity:get_user(user_id=26d170ed749e495e8c4adc26cb1aaae7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:02.366231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fccc13-9c6b-4b7e-9520-d93b9c02890e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:02.367828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 29/55] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:02 2022] GET /identity/v3/users/26d170ed749e495e8c4adc26cb1aaae7 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:02.373295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf37f8-b8a1-4ca9-91fe-572d86b6f35c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:02.415202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:02.476091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf37f8-b8a1-4ca9-91fe-572d86b6f35c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:02.509299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a5a8c-bc00-473b-9b77-c0ef58b0e94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:02.509975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5a8c-bc00-473b-9b77-c0ef58b0e94e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:02.510266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5a8c-bc00-473b-9b77-c0ef58b0e94e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:02.510541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a5a8c-bc00-473b-9b77-c0ef58b0e94e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:02.511695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a5a8c-bc00-473b-9b77-c0ef58b0e94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:02.513171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a5a8c-bc00-473b-9b77-c0ef58b0e94e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:02.514757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 27/56] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:02.520469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fccc13-9c6b-4b7e-9520-d93b9c02890e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:02.617453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fccc13-9c6b-4b7e-9520-d93b9c02890e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:02.650352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7a77e-3c41-4d9c-8a9d-0e921d990d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:02.650965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a77e-3c41-4d9c-8a9d-0e921d990d1b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:02.651252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a77e-3c41-4d9c-8a9d-0e921d990d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:02.651531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7a77e-3c41-4d9c-8a9d-0e921d990d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:02.652359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7a77e-3c41-4d9c-8a9d-0e921d990d1b None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.domain.id=default, user.id=26d170ed749e495e8c4adc26cb1aaae7) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:02.652672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7a77e-3c41-4d9c-8a9d-0e921d990d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:02.654133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7a77e-3c41-4d9c-8a9d-0e921d990d1b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:02.660045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 30/57] 10.222.0.57 () {56 vars in 1322 bytes} [Tue Aug 2 21:26:02 2022] GET /identity/v3/role_assignments?user.id=26d170ed749e495e8c4adc26cb1aaae7&scope.domain.id=default&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:04.047493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f2e7-10d3-4d83-a50c-4cc69d39c555 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:04.047988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f2e7-10d3-4d83-a50c-4cc69d39c555 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:04.048071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f2e7-10d3-4d83-a50c-4cc69d39c555 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:04.049466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 28/58] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:04.054705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22a8bc-165f-4d42-9693-b418ba23b0df None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:04.055108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22a8bc-165f-4d42-9693-b418ba23b0df None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:04.055274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22a8bc-165f-4d42-9693-b418ba23b0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:04.073332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-df22a8bc-165f-4d42-9693-b418ba23b0df None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:04.074521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-df22a8bc-165f-4d42-9693-b418ba23b0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:04.084836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:04.141384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 31/59] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:04.165690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3f2e7-10d3-4d83-a50c-4cc69d39c555 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:04.273756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3f2e7-10d3-4d83-a50c-4cc69d39c555 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:04.282840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:04.307327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed1a36-1fd9-4776-b7f0-e9ea1d938234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:04.307909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1a36-1fd9-4776-b7f0-e9ea1d938234 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:04.308220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1a36-1fd9-4776-b7f0-e9ea1d938234 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:04.308499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed1a36-1fd9-4776-b7f0-e9ea1d938234 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:04.309638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed1a36-1fd9-4776-b7f0-e9ea1d938234 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:04.311090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed1a36-1fd9-4776-b7f0-e9ea1d938234 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:04.312767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 29/60] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:04.318370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22a8bc-165f-4d42-9693-b418ba23b0df None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:04.412669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22a8bc-165f-4d42-9693-b418ba23b0df None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:04.444976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8cd2c-cc76-4a45-9c3e-8d5c612f5733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:04.446230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cd2c-cc76-4a45-9c3e-8d5c612f5733 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:04.446512 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cd2c-cc76-4a45-9c3e-8d5c612f5733 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:04.446786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8cd2c-cc76-4a45-9c3e-8d5c612f5733 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:04.447474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8cd2c-cc76-4a45-9c3e-8d5c612f5733 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:04.448945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8cd2c-cc76-4a45-9c3e-8d5c612f5733 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:04.473738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 32/61] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:04 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:07.460181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c4dcd-fd55-4282-9ec0-ef8064aece8e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:07.460712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c4dcd-fd55-4282-9ec0-ef8064aece8e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:07.460922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c4dcd-fd55-4282-9ec0-ef8064aece8e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:07.462322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 30/62] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:07.477964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5635-3364-4c29-a2b8-68d30879f209 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:07.478447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5635-3364-4c29-a2b8-68d30879f209 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:07.478515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a5635-3364-4c29-a2b8-68d30879f209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:07.490068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:07.505406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b69a5635-3364-4c29-a2b8-68d30879f209 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:07.506648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b69a5635-3364-4c29-a2b8-68d30879f209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:07.606496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 33/63] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:07.641316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c4dcd-fd55-4282-9ec0-ef8064aece8e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:07.677730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35e14-052d-4ba9-89bd-9ea6c2aacf00 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:07.678059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35e14-052d-4ba9-89bd-9ea6c2aacf00 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:07.678290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf35e14-052d-4ba9-89bd-9ea6c2aacf00 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:07.680405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 34/64] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:07.685133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab498-c89b-43b9-9f5d-904235358c2f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:07.685419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab498-c89b-43b9-9f5d-904235358c2f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:07.685693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ab498-c89b-43b9-9f5d-904235358c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:07.711008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-629ab498-c89b-43b9-9f5d-904235358c2f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:07.712179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-629ab498-c89b-43b9-9f5d-904235358c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:07.792591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c4dcd-fd55-4282-9ec0-ef8064aece8e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:07.835667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 35/65] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:07.858429 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab498-c89b-43b9-9f5d-904235358c2f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:07.872380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57c82-63dd-4da7-aa08-01dd8570df86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:07.874730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57c82-63dd-4da7-aa08-01dd8570df86 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:07.875017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57c82-63dd-4da7-aa08-01dd8570df86 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:07.875293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57c82-63dd-4da7-aa08-01dd8570df86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:07.898824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b57c82-63dd-4da7-aa08-01dd8570df86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-00b57c82-63dd-4da7-aa08-01dd8570df86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:07.903896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:07.904922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:07.906183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:07.914292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 31/66] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:07.915124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57c82-63dd-4da7-aa08-01dd8570df86 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:07.962480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:07.967282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:08.018533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ab498-c89b-43b9-9f5d-904235358c2f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.037561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57c82-63dd-4da7-aa08-01dd8570df86 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.065560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c1cbf-a5ba-48dc-b31b-1cd698e1c3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.066613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1cbf-a5ba-48dc-b31b-1cd698e1c3db None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.066903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1cbf-a5ba-48dc-b31b-1cd698e1c3db None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.067178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c1cbf-a5ba-48dc-b31b-1cd698e1c3db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.075007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77611a6b-19d3-4e3b-a019-03c412b291d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.075877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611a6b-19d3-4e3b-a019-03c412b291d2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.076383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611a6b-19d3-4e3b-a019-03c412b291d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.076851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77611a6b-19d3-4e3b-a019-03c412b291d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.077772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77611a6b-19d3-4e3b-a019-03c412b291d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:08.078300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77611a6b-19d3-4e3b-a019-03c412b291d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:08.079550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322c1cbf-a5ba-48dc-b31b-1cd698e1c3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:08.080125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77611a6b-19d3-4e3b-a019-03c412b291d2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-322c1cbf-a5ba-48dc-b31b-1cd698e1c3db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:08.085253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:08.086598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:08.087347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 36/67] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:08.088724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0edde-6436-4e63-9ec7-efa0b39c5766 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.088922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0edde-6436-4e63-9ec7-efa0b39c5766 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.089195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db0edde-6436-4e63-9ec7-efa0b39c5766 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.091243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 37/68] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:08.096085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0edde-6436-4e63-9ec7-efa0b39c5766 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:08.098419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 32/69] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:08.100128 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ad7f5-0549-4546-8597-ad769ccf964f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.100455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ad7f5-0549-4546-8597-ad769ccf964f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.100734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ad7f5-0549-4546-8597-ad769ccf964f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.120009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-303ad7f5-0549-4546-8597-ad769ccf964f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:08.121272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-303ad7f5-0549-4546-8597-ad769ccf964f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:08.193596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 33/70] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:08.194685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ad7f5-0549-4546-8597-ad769ccf964f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:08.220256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db0edde-6436-4e63-9ec7-efa0b39c5766 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.235247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:08.246141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:08.258322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c689415-5d17-497b-91ab-c239ea871f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.258945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689415-5d17-497b-91ab-c239ea871f7c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.259233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689415-5d17-497b-91ab-c239ea871f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.259514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c689415-5d17-497b-91ab-c239ea871f7c None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.260270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c689415-5d17-497b-91ab-c239ea871f7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:08.260582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c689415-5d17-497b-91ab-c239ea871f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:08.262015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c689415-5d17-497b-91ab-c239ea871f7c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:08.269845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 38/71] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:08.271006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df51a15-f4b3-4651-940b-7e7e0216f686 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.271307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df51a15-f4b3-4651-940b-7e7e0216f686 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.271649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df51a15-f4b3-4651-940b-7e7e0216f686 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.276311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 39/72] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:08.276311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6f72f-90ba-4156-9c48-49dc864fc1de None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.276311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6f72f-90ba-4156-9c48-49dc864fc1de None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.276311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6f72f-90ba-4156-9c48-49dc864fc1de None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.276311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 40/73] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:08.277016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6f72f-90ba-4156-9c48-49dc864fc1de None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:08.312635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ad7f5-0549-4546-8597-ad769ccf964f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.345184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a73549-1465-41e2-ad10-0634c674defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.345828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a73549-1465-41e2-ad10-0634c674defa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.346108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a73549-1465-41e2-ad10-0634c674defa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.346383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a73549-1465-41e2-ad10-0634c674defa None admin] PATH_INFO: `/v3/users/c3a3b12c08684d71aa48c75435606f10` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.361588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a73549-1465-41e2-ad10-0634c674defa None admin] RBAC: Authorizing `identity:get_user(user_id=c3a3b12c08684d71aa48c75435606f10)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:08.363060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a73549-1465-41e2-ad10-0634c674defa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:08.364706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 34/74] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:08 2022] GET /identity/v3/users/c3a3b12c08684d71aa48c75435606f10 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:08.369381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a73549-1465-41e2-ad10-0634c674defa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:08.376107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6f72f-90ba-4156-9c48-49dc864fc1de None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.409788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18359e6-79aa-4c71-b138-044a1f44eb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.410428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18359e6-79aa-4c71-b138-044a1f44eb01 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.410714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18359e6-79aa-4c71-b138-044a1f44eb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.410996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18359e6-79aa-4c71-b138-044a1f44eb01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.421073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18359e6-79aa-4c71-b138-044a1f44eb01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b18359e6-79aa-4c71-b138-044a1f44eb01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:08.426417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:08.427419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:08.428321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 41/75] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:08.429028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7dd25-970a-49c4-a317-a022e582ab7a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.429089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7dd25-970a-49c4-a317-a022e582ab7a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.429436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7dd25-970a-49c4-a317-a022e582ab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.447176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-acf7dd25-970a-49c4-a317-a022e582ab7a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:08.448399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-acf7dd25-970a-49c4-a317-a022e582ab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:08.454432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:08.469757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a73549-1465-41e2-ad10-0634c674defa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.488358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:08.501706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b2ca3-1fe0-4169-8cdc-cf19b148a955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.502346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b2ca3-1fe0-4169-8cdc-cf19b148a955 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.502628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b2ca3-1fe0-4169-8cdc-cf19b148a955 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.502900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b2ca3-1fe0-4169-8cdc-cf19b148a955 None admin] PATH_INFO: `/v3/users/26d170ed749e495e8c4adc26cb1aaae7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.504057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b2ca3-1fe0-4169-8cdc-cf19b148a955 None admin] RBAC: Authorizing `identity:get_user(user_id=26d170ed749e495e8c4adc26cb1aaae7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:08.505531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b2ca3-1fe0-4169-8cdc-cf19b148a955 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:08.507303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 35/76] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:08 2022] GET /identity/v3/users/26d170ed749e495e8c4adc26cb1aaae7 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:08.508733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f02d2e-6b10-4016-a84b-0345893a0788 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.509013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f02d2e-6b10-4016-a84b-0345893a0788 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.509286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f02d2e-6b10-4016-a84b-0345893a0788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.532154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 42/77] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:08.532154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7dd25-970a-49c4-a317-a022e582ab7a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:08.532370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-46f02d2e-6b10-4016-a84b-0345893a0788 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:08.532370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46f02d2e-6b10-4016-a84b-0345893a0788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:08.594485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 36/78] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:08.595340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f02d2e-6b10-4016-a84b-0345893a0788 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:08.627127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7dd25-970a-49c4-a317-a022e582ab7a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.661238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44c998-b4e4-4a07-8a1b-7d396cd92d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.661919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44c998-b4e4-4a07-8a1b-7d396cd92d7d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.662210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44c998-b4e4-4a07-8a1b-7d396cd92d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.662492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44c998-b4e4-4a07-8a1b-7d396cd92d7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.684052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:08.700165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f02d2e-6b10-4016-a84b-0345893a0788 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.705487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:08.731833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44c998-b4e4-4a07-8a1b-7d396cd92d7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:08.733133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc073416-b61a-4a5e-b011-999bdb239010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.733368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44c998-b4e4-4a07-8a1b-7d396cd92d7d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:08.733746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc073416-b61a-4a5e-b011-999bdb239010 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.734025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc073416-b61a-4a5e-b011-999bdb239010 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.734295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc073416-b61a-4a5e-b011-999bdb239010 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.735010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc073416-b61a-4a5e-b011-999bdb239010 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:08.735316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc073416-b61a-4a5e-b011-999bdb239010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:08.736699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc073416-b61a-4a5e-b011-999bdb239010 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:08.744870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 37/79] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:08.745585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc073416-b61a-4a5e-b011-999bdb239010 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:08.832068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 43/80] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:08.836727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44c998-b4e4-4a07-8a1b-7d396cd92d7d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:08.848447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc073416-b61a-4a5e-b011-999bdb239010 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.880984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6305a-a0ff-4918-aa8a-6c9d94294035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.881590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6305a-a0ff-4918-aa8a-6c9d94294035 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.881872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6305a-a0ff-4918-aa8a-6c9d94294035 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.882143 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6305a-a0ff-4918-aa8a-6c9d94294035 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.897074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:08.905325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:08.930957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44c998-b4e4-4a07-8a1b-7d396cd92d7d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:08.947909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6305a-a0ff-4918-aa8a-6c9d94294035 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:08.949405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6305a-a0ff-4918-aa8a-6c9d94294035 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:08.965403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26c43b-c64e-44ee-addc-54f9eb364f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:08.966038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26c43b-c64e-44ee-addc-54f9eb364f58 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:08.966318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26c43b-c64e-44ee-addc-54f9eb364f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:08.966590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26c43b-c64e-44ee-addc-54f9eb364f58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:08.976484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c26c43b-c64e-44ee-addc-54f9eb364f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7c26c43b-c64e-44ee-addc-54f9eb364f58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:08.981325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:08.982224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:08.982950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 44/81] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:08.983604 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26c43b-c64e-44ee-addc-54f9eb364f58 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.047577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 38/82] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:09.048553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6305a-a0ff-4918-aa8a-6c9d94294035 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.081899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26c43b-c64e-44ee-addc-54f9eb364f58 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.099191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:09.114654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981fa2e-4401-4080-b39c-c641a912a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.115292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981fa2e-4401-4080-b39c-c641a912a21b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.115580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981fa2e-4401-4080-b39c-c641a912a21b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.115857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981fa2e-4401-4080-b39c-c641a912a21b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:09.117626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981fa2e-4401-4080-b39c-c641a912a21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:09.119095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981fa2e-4401-4080-b39c-c641a912a21b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:09.120702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 45/83] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:09.121466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981fa2e-4401-4080-b39c-c641a912a21b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.125703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:09.154244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6305a-a0ff-4918-aa8a-6c9d94294035 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.188580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94c46-01c2-4f6b-8f62-f91f1f49bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.189217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94c46-01c2-4f6b-8f62-f91f1f49bc57 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.189494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94c46-01c2-4f6b-8f62-f91f1f49bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.189766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94c46-01c2-4f6b-8f62-f91f1f49bc57 None admin] PATH_INFO: `/v3/users/c3a3b12c08684d71aa48c75435606f10` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:09.190954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94c46-01c2-4f6b-8f62-f91f1f49bc57 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a3b12c08684d71aa48c75435606f10)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:09.192406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94c46-01c2-4f6b-8f62-f91f1f49bc57 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:09.193984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 39/84] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:09 2022] GET /identity/v3/users/c3a3b12c08684d71aa48c75435606f10 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:09.194761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94c46-01c2-4f6b-8f62-f91f1f49bc57 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.221841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981fa2e-4401-4080-b39c-c641a912a21b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.255238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b42403-85ea-437f-a9cc-43a27b57cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.255881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b42403-85ea-437f-a9cc-43a27b57cece None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.256189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b42403-85ea-437f-a9cc-43a27b57cece None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.256473 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b42403-85ea-437f-a9cc-43a27b57cece None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:09.257665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b42403-85ea-437f-a9cc-43a27b57cece None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:09.259102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b42403-85ea-437f-a9cc-43a27b57cece None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:09.260785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 46/85] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:09 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:09.261637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b42403-85ea-437f-a9cc-43a27b57cece None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.300673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94c46-01c2-4f6b-8f62-f91f1f49bc57 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.314532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:09.330938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:09.335962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89715e9e-70e9-41fb-a735-0ee6a8c377cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.336620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89715e9e-70e9-41fb-a735-0ee6a8c377cb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.336905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89715e9e-70e9-41fb-a735-0ee6a8c377cb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.337183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89715e9e-70e9-41fb-a735-0ee6a8c377cb None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:09.338324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89715e9e-70e9-41fb-a735-0ee6a8c377cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:09.338719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89715e9e-70e9-41fb-a735-0ee6a8c377cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:09.340518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89715e9e-70e9-41fb-a735-0ee6a8c377cb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:09.348759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 40/86] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:09.348759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89715e9e-70e9-41fb-a735-0ee6a8c377cb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.367372 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b42403-85ea-437f-a9cc-43a27b57cece None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.399907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714d224-0fb3-4c65-bd34-08495d420b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.400609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714d224-0fb3-4c65-bd34-08495d420b81 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.400897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714d224-0fb3-4c65-bd34-08495d420b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.401179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714d224-0fb3-4c65-bd34-08495d420b81 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:09.402338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714d224-0fb3-4c65-bd34-08495d420b81 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:09.403786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714d224-0fb3-4c65-bd34-08495d420b81 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:09.405476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 47/87] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:09 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:09.406499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714d224-0fb3-4c65-bd34-08495d420b81 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.448994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89715e9e-70e9-41fb-a735-0ee6a8c377cb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.481602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39a8d-e33f-403d-9256-e1a2dfe57f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.482222 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39a8d-e33f-403d-9256-e1a2dfe57f86 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.482509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39a8d-e33f-403d-9256-e1a2dfe57f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.482790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd39a8d-e33f-403d-9256-e1a2dfe57f86 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:09.483474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd39a8d-e33f-403d-9256-e1a2dfe57f86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:09.484948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd39a8d-e33f-403d-9256-e1a2dfe57f86 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:09.504788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714d224-0fb3-4c65-bd34-08495d420b81 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.511737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 41/88] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:09 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:09.511737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39a8d-e33f-403d-9256-e1a2dfe57f86 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.549735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:09.552107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531a0b2-a00a-43f5-b626-29a086d786ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.553281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531a0b2-a00a-43f5-b626-29a086d786ab None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.553774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531a0b2-a00a-43f5-b626-29a086d786ab None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.554273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c531a0b2-a00a-43f5-b626-29a086d786ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:09.565871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:09.628213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd39a8d-e33f-403d-9256-e1a2dfe57f86 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.634188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531a0b2-a00a-43f5-b626-29a086d786ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:09.635715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c531a0b2-a00a-43f5-b626-29a086d786ab None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:09.670813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6ffc9-0485-4f6f-a1a3-4f6b8e5e2d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.671479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6ffc9-0485-4f6f-a1a3-4f6b8e5e2d1e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.671764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6ffc9-0485-4f6f-a1a3-4f6b8e5e2d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.672040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6ffc9-0485-4f6f-a1a3-4f6b8e5e2d1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:09.672862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6ffc9-0485-4f6f-a1a3-4f6b8e5e2d1e None admin] RBAC: Adding query filter params (role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=729d3dec279d497d9feb72ae57cadd8c, user.id=c3a3b12c08684d71aa48c75435606f10) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:09.673176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6ffc9-0485-4f6f-a1a3-4f6b8e5e2d1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:09.674608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6ffc9-0485-4f6f-a1a3-4f6b8e5e2d1e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:09.683393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 42/89] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:09 2022] GET /identity/v3/role_assignments?user.id=c3a3b12c08684d71aa48c75435606f10&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:09.684054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6ffc9-0485-4f6f-a1a3-4f6b8e5e2d1e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.793699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 48/90] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:09.794564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531a0b2-a00a-43f5-b626-29a086d786ab None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.838042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:09.844846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6ffc9-0485-4f6f-a1a3-4f6b8e5e2d1e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.873661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:09.891996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9c35-2552-438c-b423-25dd9a8effe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.892702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9c35-2552-438c-b423-25dd9a8effe5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.893031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9c35-2552-438c-b423-25dd9a8effe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.893318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f9c35-2552-438c-b423-25dd9a8effe5 None admin] PATH_INFO: `/v3/users/c3a3b12c08684d71aa48c75435606f10` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:09.894620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f9c35-2552-438c-b423-25dd9a8effe5 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a3b12c08684d71aa48c75435606f10)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:09.896263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f9c35-2552-438c-b423-25dd9a8effe5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:09.898557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 43/91] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:09 2022] GET /identity/v3/users/c3a3b12c08684d71aa48c75435606f10 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:09.899341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9c35-2552-438c-b423-25dd9a8effe5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:09.954386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c531a0b2-a00a-43f5-b626-29a086d786ab None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:09.997493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6baaf-dc22-435b-87bf-c0a69dd34353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:09.998488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6baaf-dc22-435b-87bf-c0a69dd34353 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:09.998969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6baaf-dc22-435b-87bf-c0a69dd34353 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:09.999443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6baaf-dc22-435b-87bf-c0a69dd34353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:10.000480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6baaf-dc22-435b-87bf-c0a69dd34353 None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=729d3dec279d497d9feb72ae57cadd8c, user.id=26d170ed749e495e8c4adc26cb1aaae7) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:10.001026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6baaf-dc22-435b-87bf-c0a69dd34353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:10.002701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6baaf-dc22-435b-87bf-c0a69dd34353 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:10.009594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 49/92] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:09 2022] GET /identity/v3/role_assignments?user.id=26d170ed749e495e8c4adc26cb1aaae7&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:10.010757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6baaf-dc22-435b-87bf-c0a69dd34353 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:10.013170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f9c35-2552-438c-b423-25dd9a8effe5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:10.058627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55be545-83ca-4961-bb56-14890d93912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:10.059284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55be545-83ca-4961-bb56-14890d93912b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:10.059566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55be545-83ca-4961-bb56-14890d93912b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:10.059857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55be545-83ca-4961-bb56-14890d93912b None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:10.061634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55be545-83ca-4961-bb56-14890d93912b None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:10.063317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55be545-83ca-4961-bb56-14890d93912b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:10.065667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 44/93] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:09 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:10.072322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55be545-83ca-4961-bb56-14890d93912b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:10.106007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:10.130412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6baaf-dc22-435b-87bf-c0a69dd34353 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:10.144531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:10.178356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3e27d-809d-4b21-bae1-525d9b0cdfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:10.180021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3e27d-809d-4b21-bae1-525d9b0cdfba None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:10.180701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3e27d-809d-4b21-bae1-525d9b0cdfba None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:10.181279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3e27d-809d-4b21-bae1-525d9b0cdfba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:10.184972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55be545-83ca-4961-bb56-14890d93912b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:10.225365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826468c9-ed74-4ccd-bcdd-a42ddc64c392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:10.225999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826468c9-ed74-4ccd-bcdd-a42ddc64c392 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:10.226800 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826468c9-ed74-4ccd-bcdd-a42ddc64c392 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:10.227075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826468c9-ed74-4ccd-bcdd-a42ddc64c392 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:10.227871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826468c9-ed74-4ccd-bcdd-a42ddc64c392 None admin] RBAC: Adding query filter params (role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=729d3dec279d497d9feb72ae57cadd8c, user.id=c3a3b12c08684d71aa48c75435606f10) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:10.228209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826468c9-ed74-4ccd-bcdd-a42ddc64c392 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:10.229684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826468c9-ed74-4ccd-bcdd-a42ddc64c392 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:10.243038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 45/94] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:10 2022] GET /identity/v3/role_assignments?user.id=c3a3b12c08684d71aa48c75435606f10&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=67ac8da7e16f46b496e98633276e6909 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:10.283148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3e27d-809d-4b21-bae1-525d9b0cdfba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:10.284806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3e27d-809d-4b21-bae1-525d9b0cdfba None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:10.435180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 50/95] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:10.441240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826468c9-ed74-4ccd-bcdd-a42ddc64c392 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:10.557025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:10.564031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826468c9-ed74-4ccd-bcdd-a42ddc64c392 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:10.602710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e88a9b-7a46-4377-84d6-63b938996fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:10.603745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e88a9b-7a46-4377-84d6-63b938996fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:10.604274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e88a9b-7a46-4377-84d6-63b938996fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:10.604753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e88a9b-7a46-4377-84d6-63b938996fe6 None admin] PATH_INFO: `/v3/projects/8658ff8f2382431881e8dba8a967d512` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:10.606148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e88a9b-7a46-4377-84d6-63b938996fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=8658ff8f2382431881e8dba8a967d512)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:10.607796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e88a9b-7a46-4377-84d6-63b938996fe6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:10.609767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 46/96] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:10 2022] GET /identity/v3/projects/8658ff8f2382431881e8dba8a967d512 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:10.617462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3e27d-809d-4b21-bae1-525d9b0cdfba None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:10.619584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:10.751992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3e27d-809d-4b21-bae1-525d9b0cdfba None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:10.801044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d6a3d-3964-489b-b531-6e6ac6d5a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:10.801687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6a3d-3964-489b-b531-6e6ac6d5a907 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:10.801974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6a3d-3964-489b-b531-6e6ac6d5a907 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:10.802248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d6a3d-3964-489b-b531-6e6ac6d5a907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:10.805311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d6a3d-3964-489b-b531-6e6ac6d5a907 None admin] RBAC: Adding query filter params (role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=8658ff8f2382431881e8dba8a967d512, user.id=c3a3b12c08684d71aa48c75435606f10) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:10.805311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d6a3d-3964-489b-b531-6e6ac6d5a907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:10.805311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d6a3d-3964-489b-b531-6e6ac6d5a907 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:10.812320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 51/97] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:10 2022] GET /identity/v3/role_assignments?user.id=c3a3b12c08684d71aa48c75435606f10&scope.project.id=8658ff8f2382431881e8dba8a967d512&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:12.449466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0e952-fbf0-4490-9e7b-3d91775276b1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:12.450539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0e952-fbf0-4490-9e7b-3d91775276b1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:12.451049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0e952-fbf0-4490-9e7b-3d91775276b1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:12.452662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 47/98] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:12.457923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06757819-6296-47b3-b04a-37e05fd7f4ea None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:12.458737 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06757819-6296-47b3-b04a-37e05fd7f4ea None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:12.459199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06757819-6296-47b3-b04a-37e05fd7f4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:12.493177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-06757819-6296-47b3-b04a-37e05fd7f4ea None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:12.494723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-06757819-6296-47b3-b04a-37e05fd7f4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:12.561468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:12.568975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 52/99] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:12.592870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0e952-fbf0-4490-9e7b-3d91775276b1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:12.613605 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db5f9-ea2e-48c0-a698-311d86ee8c16 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:12.613901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db5f9-ea2e-48c0-a698-311d86ee8c16 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:12.614174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db5f9-ea2e-48c0-a698-311d86ee8c16 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:12.616078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 53/100] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:12.626325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca13cb-183a-48d4-8c9e-eafac9b6f0ce None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:12.626782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca13cb-183a-48d4-8c9e-eafac9b6f0ce None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:12.627213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca13cb-183a-48d4-8c9e-eafac9b6f0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:12.662806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8dca13cb-183a-48d4-8c9e-eafac9b6f0ce None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:12.664296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8dca13cb-183a-48d4-8c9e-eafac9b6f0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:12.745149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0e952-fbf0-4490-9e7b-3d91775276b1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:12.785857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f74d7d-b913-43bc-8ce3-cb684e99ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:12.786777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f74d7d-b913-43bc-8ce3-cb684e99ccbc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:12.787202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f74d7d-b913-43bc-8ce3-cb684e99ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:12.787618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f74d7d-b913-43bc-8ce3-cb684e99ccbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:12.804754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f74d7d-b913-43bc-8ce3-cb684e99ccbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:12.820414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 54/101] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a1f74d7d-b913-43bc-8ce3-cb684e99ccbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:12.820992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:12.821807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:12.822527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 48/102] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:12.829333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca13cb-183a-48d4-8c9e-eafac9b6f0ce None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:12.871815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f74d7d-b913-43bc-8ce3-cb684e99ccbc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:12.899411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:12.985397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca13cb-183a-48d4-8c9e-eafac9b6f0ce None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:13.019498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:13.029099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b794f-8369-484c-8c16-88e0256fb269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:13.029920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b794f-8369-484c-8c16-88e0256fb269 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.030288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b794f-8369-484c-8c16-88e0256fb269 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.030516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b794f-8369-484c-8c16-88e0256fb269 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.031510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b794f-8369-484c-8c16-88e0256fb269 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:13.031627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f74d7d-b913-43bc-8ce3-cb684e99ccbc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:13.031825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b794f-8369-484c-8c16-88e0256fb269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:13.033394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b794f-8369-484c-8c16-88e0256fb269 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:13.055299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 55/103] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:13.056631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a7ac5-ceb7-42ad-be47-9a98a6639b28 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.056922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a7ac5-ceb7-42ad-be47-9a98a6639b28 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.057199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a7ac5-ceb7-42ad-be47-9a98a6639b28 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.058843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 56/104] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:13.065207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a7ac5-ceb7-42ad-be47-9a98a6639b28 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:13.082580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d88f5-559d-44a9-b120-4adc849e70da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:13.083232 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d88f5-559d-44a9-b120-4adc849e70da None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.083517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d88f5-559d-44a9-b120-4adc849e70da None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.083792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d88f5-559d-44a9-b120-4adc849e70da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.085024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d88f5-559d-44a9-b120-4adc849e70da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:13.086549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d88f5-559d-44a9-b120-4adc849e70da None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:13.092254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 49/105] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:13.093570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754943-9d07-4e00-9df3-e2dfa6580a19 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.093866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754943-9d07-4e00-9df3-e2dfa6580a19 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.094146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754943-9d07-4e00-9df3-e2dfa6580a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.114572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f8754943-9d07-4e00-9df3-e2dfa6580a19 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:13.115871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f8754943-9d07-4e00-9df3-e2dfa6580a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:13.186991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 50/106] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:13.188196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754943-9d07-4e00-9df3-e2dfa6580a19 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:13.212797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a7ac5-ceb7-42ad-be47-9a98a6639b28 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:13.217406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:13.247504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ba486-8803-4442-bcaa-801eebd0ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:13.248164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ba486-8803-4442-bcaa-801eebd0ec1a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.248455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ba486-8803-4442-bcaa-801eebd0ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.248730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ba486-8803-4442-bcaa-801eebd0ec1a None admin] PATH_INFO: `/v3/users/da75272d23e9485d93ba11805e13d8ae` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.262411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ba486-8803-4442-bcaa-801eebd0ec1a None admin] RBAC: Authorizing `identity:get_user(user_id=da75272d23e9485d93ba11805e13d8ae)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:13.264380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ba486-8803-4442-bcaa-801eebd0ec1a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:13.266020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 57/107] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:13 2022] GET /identity/v3/users/da75272d23e9485d93ba11805e13d8ae => generated 289 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:13.267244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8feea4-99ac-4e30-ab87-92a14f55ae0b None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.267532 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8feea4-99ac-4e30-ab87-92a14f55ae0b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.267810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8feea4-99ac-4e30-ab87-92a14f55ae0b None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.269235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 58/108] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:13.270185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8b714-3973-4f22-9e10-31feef731713 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.270410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8b714-3973-4f22-9e10-31feef731713 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.270692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8b714-3973-4f22-9e10-31feef731713 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.272029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 59/109] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:13.272597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8b714-3973-4f22-9e10-31feef731713 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:13.306363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754943-9d07-4e00-9df3-e2dfa6580a19 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:13.325149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:13.343892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a271295-cf43-4e93-99a6-b6f32665c0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:13.344550 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a271295-cf43-4e93-99a6-b6f32665c0c7 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.344836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a271295-cf43-4e93-99a6-b6f32665c0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.345116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a271295-cf43-4e93-99a6-b6f32665c0c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.345790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a271295-cf43-4e93-99a6-b6f32665c0c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:13.347239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a271295-cf43-4e93-99a6-b6f32665c0c7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:13.384167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 51/110] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:26:13 2022] POST /identity/v3/projects => generated 302 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:13.384167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516331e4-029b-41ca-bcc9-a287b2eeaa70 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.384167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516331e4-029b-41ca-bcc9-a287b2eeaa70 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.384167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516331e4-029b-41ca-bcc9-a287b2eeaa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.395403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-516331e4-029b-41ca-bcc9-a287b2eeaa70 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:13.396655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-516331e4-029b-41ca-bcc9-a287b2eeaa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:13.405891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8b714-3973-4f22-9e10-31feef731713 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:13.446397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4ddb-e711-4c5d-92c4-aa94eef5655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:13.447236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4ddb-e711-4c5d-92c4-aa94eef5655a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.447595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4ddb-e711-4c5d-92c4-aa94eef5655a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.447980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4ddb-e711-4c5d-92c4-aa94eef5655a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.462551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a4ddb-e711-4c5d-92c4-aa94eef5655a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b99a4ddb-e711-4c5d-92c4-aa94eef5655a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:13.469005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:13.469905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:13.470666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:13.471628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 60/111] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:13.472103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 52/112] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:13.477743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d21f53-6851-410a-b638-41ad5fbab0a9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.478172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d21f53-6851-410a-b638-41ad5fbab0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.478906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d21f53-6851-410a-b638-41ad5fbab0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.479977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516331e4-029b-41ca-bcc9-a287b2eeaa70 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:13.483755 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:13.501303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-78d21f53-6851-410a-b638-41ad5fbab0a9 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:13.502706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-78d21f53-6851-410a-b638-41ad5fbab0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:13.589939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 61/113] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:13.591093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d21f53-6851-410a-b638-41ad5fbab0a9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:13.610726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516331e4-029b-41ca-bcc9-a287b2eeaa70 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:13.636384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:13.651668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7364e8b-429d-4d6d-8a31-36c1af352887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:13.652551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7364e8b-429d-4d6d-8a31-36c1af352887 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.652998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7364e8b-429d-4d6d-8a31-36c1af352887 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.653412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7364e8b-429d-4d6d-8a31-36c1af352887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.717055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d21f53-6851-410a-b638-41ad5fbab0a9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:13.732749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7364e8b-429d-4d6d-8a31-36c1af352887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:13.734446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7364e8b-429d-4d6d-8a31-36c1af352887 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:13.738252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:13.761191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578faefb-5975-4a3b-bd71-8b5bcae12722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:13.761907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578faefb-5975-4a3b-bd71-8b5bcae12722 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.762256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578faefb-5975-4a3b-bd71-8b5bcae12722 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.762597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578faefb-5975-4a3b-bd71-8b5bcae12722 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.763387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578faefb-5975-4a3b-bd71-8b5bcae12722 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:13.763759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578faefb-5975-4a3b-bd71-8b5bcae12722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:13.765348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578faefb-5975-4a3b-bd71-8b5bcae12722 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:13.773953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 62/114] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:13.774650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578faefb-5975-4a3b-bd71-8b5bcae12722 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:13.848631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 53/115] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:13.850030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7364e8b-429d-4d6d-8a31-36c1af352887 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:13.890444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:13.894496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578faefb-5975-4a3b-bd71-8b5bcae12722 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:13.932247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c551e4-711b-4e99-9575-77261fa41ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:13.933168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c551e4-711b-4e99-9575-77261fa41ccb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:13.933357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c551e4-711b-4e99-9575-77261fa41ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:13.933588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c551e4-711b-4e99-9575-77261fa41ccb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:13.944844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c551e4-711b-4e99-9575-77261fa41ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-02c551e4-711b-4e99-9575-77261fa41ccb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:13.950848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:13.951665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:13.952436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 63/116] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:13.953029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c551e4-711b-4e99-9575-77261fa41ccb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:13.963261 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7364e8b-429d-4d6d-8a31-36c1af352887 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:13.966709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:14.002529 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a3d9-b6a9-4b84-b4d9-e13f4ab7dafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.003676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a3d9-b6a9-4b84-b4d9-e13f4ab7dafe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.004308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a3d9-b6a9-4b84-b4d9-e13f4ab7dafe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.004823 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a3d9-b6a9-4b84-b4d9-e13f4ab7dafe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.016079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08a3d9-b6a9-4b84-b4d9-e13f4ab7dafe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-cd08a3d9-b6a9-4b84-b4d9-e13f4ab7dafe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:14.021863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:14.022683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:14.023944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:14.026469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 54/117] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:14.027538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a3d9-b6a9-4b84-b4d9-e13f4ab7dafe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.066287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c551e4-711b-4e99-9575-77261fa41ccb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.100353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c03ae-078f-4a3f-8897-2d861a9b0696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.100971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c03ae-078f-4a3f-8897-2d861a9b0696 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.101768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c03ae-078f-4a3f-8897-2d861a9b0696 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.102051 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c03ae-078f-4a3f-8897-2d861a9b0696 None admin] PATH_INFO: `/v3/users/c3a3b12c08684d71aa48c75435606f10` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.103233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c03ae-078f-4a3f-8897-2d861a9b0696 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a3b12c08684d71aa48c75435606f10)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.104745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c03ae-078f-4a3f-8897-2d861a9b0696 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.106504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 64/118] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:13 2022] GET /identity/v3/users/c3a3b12c08684d71aa48c75435606f10 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:14.111436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c03ae-078f-4a3f-8897-2d861a9b0696 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.134486 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a3d9-b6a9-4b84-b4d9-e13f4ab7dafe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.138995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:14.174352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3edb7-7661-42f4-afe4-e7eefeee5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.175163 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3edb7-7661-42f4-afe4-e7eefeee5e8f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.175456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3edb7-7661-42f4-afe4-e7eefeee5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.176061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3edb7-7661-42f4-afe4-e7eefeee5e8f None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.177546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3edb7-7661-42f4-afe4-e7eefeee5e8f None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.179791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3edb7-7661-42f4-afe4-e7eefeee5e8f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.184309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 55/119] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:14.185133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3edb7-7661-42f4-afe4-e7eefeee5e8f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.225881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:14.229643 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c03ae-078f-4a3f-8897-2d861a9b0696 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.264094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4390bb-8be6-4f6e-a828-c880e37be0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.265125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4390bb-8be6-4f6e-a828-c880e37be0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.265623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4390bb-8be6-4f6e-a828-c880e37be0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.266078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4390bb-8be6-4f6e-a828-c880e37be0a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.267079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4390bb-8be6-4f6e-a828-c880e37be0a2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:14.267469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4390bb-8be6-4f6e-a828-c880e37be0a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.268895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4390bb-8be6-4f6e-a828-c880e37be0a2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.283172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 65/120] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:14.283172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975f90a-4aeb-4296-9aa0-90b8baa622c8 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.283172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975f90a-4aeb-4296-9aa0-90b8baa622c8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.283172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975f90a-4aeb-4296-9aa0-90b8baa622c8 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.283172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 66/121] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:14.283172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975f90a-4aeb-4296-9aa0-90b8baa622c8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.310806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3edb7-7661-42f4-afe4-e7eefeee5e8f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.349614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dd1ab-1a74-4b0c-8e40-10f5fd833ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.350237 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dd1ab-1a74-4b0c-8e40-10f5fd833ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.350575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dd1ab-1a74-4b0c-8e40-10f5fd833ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.350801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dd1ab-1a74-4b0c-8e40-10f5fd833ab2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.352226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dd1ab-1a74-4b0c-8e40-10f5fd833ab2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:14.352537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dd1ab-1a74-4b0c-8e40-10f5fd833ab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.353909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dd1ab-1a74-4b0c-8e40-10f5fd833ab2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.366697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 56/122] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:14.366697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dd1ab-1a74-4b0c-8e40-10f5fd833ab2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.380105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:14.395983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975f90a-4aeb-4296-9aa0-90b8baa622c8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.432038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e337c39-9cbb-4c07-80ce-947b762ac43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.432713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e337c39-9cbb-4c07-80ce-947b762ac43b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.432994 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e337c39-9cbb-4c07-80ce-947b762ac43b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.433273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e337c39-9cbb-4c07-80ce-947b762ac43b None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.434749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e337c39-9cbb-4c07-80ce-947b762ac43b None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.435865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e337c39-9cbb-4c07-80ce-947b762ac43b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.437782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 67/123] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:14.438359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e337c39-9cbb-4c07-80ce-947b762ac43b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.469576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:14.479624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dd1ab-1a74-4b0c-8e40-10f5fd833ab2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.515651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0e2a9-4e7e-4136-847f-753f5d01d655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.516318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e2a9-4e7e-4136-847f-753f5d01d655 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.516600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e2a9-4e7e-4136-847f-753f5d01d655 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.516878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0e2a9-4e7e-4136-847f-753f5d01d655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.517659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0e2a9-4e7e-4136-847f-753f5d01d655 None admin] RBAC: Adding query filter params (role.id=e7456e6d5b404412ad235b2bfeb1df9b, scope.project.id=729d3dec279d497d9feb72ae57cadd8c, user.id=da75272d23e9485d93ba11805e13d8ae) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:14.517969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0e2a9-4e7e-4136-847f-753f5d01d655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.519404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0e2a9-4e7e-4136-847f-753f5d01d655 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.525487 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 57/124] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/role_assignments?user.id=da75272d23e9485d93ba11805e13d8ae&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=e7456e6d5b404412ad235b2bfeb1df9b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:14.526414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a056d8-a219-4081-af0c-ac1b6e49fda1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.526698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a056d8-a219-4081-af0c-ac1b6e49fda1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.526971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a056d8-a219-4081-af0c-ac1b6e49fda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.546663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f5a056d8-a219-4081-af0c-ac1b6e49fda1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:14.547961 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f5a056d8-a219-4081-af0c-ac1b6e49fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:14.562934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e337c39-9cbb-4c07-80ce-947b762ac43b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.607111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468db17-d771-4ef6-85d8-ba20598f8028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.608245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468db17-d771-4ef6-85d8-ba20598f8028 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.608245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468db17-d771-4ef6-85d8-ba20598f8028 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.608594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468db17-d771-4ef6-85d8-ba20598f8028 None admin] PATH_INFO: `/v3/users/c3a3b12c08684d71aa48c75435606f10` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.610198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468db17-d771-4ef6-85d8-ba20598f8028 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a3b12c08684d71aa48c75435606f10)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.611815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468db17-d771-4ef6-85d8-ba20598f8028 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.613936 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 68/125] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/users/c3a3b12c08684d71aa48c75435606f10 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:14.618724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468db17-d771-4ef6-85d8-ba20598f8028 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.649502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 58/126] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:14.656240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:14.656664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a056d8-a219-4081-af0c-ac1b6e49fda1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.751156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468db17-d771-4ef6-85d8-ba20598f8028 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.786831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b352e-b938-4e37-a0de-abe357d0edbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.787737 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b352e-b938-4e37-a0de-abe357d0edbd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.788178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b352e-b938-4e37-a0de-abe357d0edbd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.788625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b352e-b938-4e37-a0de-abe357d0edbd None admin] PATH_INFO: `/v3/users/26d170ed749e495e8c4adc26cb1aaae7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.789934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b352e-b938-4e37-a0de-abe357d0edbd None admin] RBAC: Authorizing `identity:get_user(user_id=26d170ed749e495e8c4adc26cb1aaae7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.790951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:14.792088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b352e-b938-4e37-a0de-abe357d0edbd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.793855 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 69/127] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/users/26d170ed749e495e8c4adc26cb1aaae7 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:14.794998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b352e-b938-4e37-a0de-abe357d0edbd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.806810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a056d8-a219-4081-af0c-ac1b6e49fda1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.855156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a013f5-c24a-4b35-b0f2-319b7044e60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.856334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a013f5-c24a-4b35-b0f2-319b7044e60d None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.856729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a013f5-c24a-4b35-b0f2-319b7044e60d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.857386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a013f5-c24a-4b35-b0f2-319b7044e60d None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c/users/c3a3b12c08684d71aa48c75435606f10/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.860083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a013f5-c24a-4b35-b0f2-319b7044e60d None admin] RBAC: Authorizing `identity:create_grant(project_id=729d3dec279d497d9feb72ae57cadd8c, user_id=c3a3b12c08684d71aa48c75435606f10, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.862341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a013f5-c24a-4b35-b0f2-319b7044e60d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.881286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 59/128] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:26:14 2022] PUT /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c/users/c3a3b12c08684d71aa48c75435606f10/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:14.883180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a013f5-c24a-4b35-b0f2-319b7044e60d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.902277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:14.914023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b352e-b938-4e37-a0de-abe357d0edbd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:14.954166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef73b29-fb6d-4567-a3a7-7f021fc78830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:14.955335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef73b29-fb6d-4567-a3a7-7f021fc78830 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:14.955848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef73b29-fb6d-4567-a3a7-7f021fc78830 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:14.956315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef73b29-fb6d-4567-a3a7-7f021fc78830 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:14.957781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef73b29-fb6d-4567-a3a7-7f021fc78830 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:14.959677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef73b29-fb6d-4567-a3a7-7f021fc78830 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:14.966822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 70/129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:14.968233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef73b29-fb6d-4567-a3a7-7f021fc78830 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:14.997863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a013f5-c24a-4b35-b0f2-319b7044e60d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:15.036059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd046a-2270-4e31-8b81-23d2e1104785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:15.036844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd046a-2270-4e31-8b81-23d2e1104785 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.037195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd046a-2270-4e31-8b81-23d2e1104785 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.037540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd046a-2270-4e31-8b81-23d2e1104785 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.049366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd046a-2270-4e31-8b81-23d2e1104785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-85dd046a-2270-4e31-8b81-23d2e1104785 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:15.055920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:15.056843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:15.057847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 60/130] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:15.058956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd046a-2270-4e31-8b81-23d2e1104785 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:15.076596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:15.091839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef73b29-fb6d-4567-a3a7-7f021fc78830 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:15.131881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6267ba7-0cb3-49fa-a282-c9aae0d7676a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:15.132919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6267ba7-0cb3-49fa-a282-c9aae0d7676a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.133433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6267ba7-0cb3-49fa-a282-c9aae0d7676a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.133913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6267ba7-0cb3-49fa-a282-c9aae0d7676a None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.135326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6267ba7-0cb3-49fa-a282-c9aae0d7676a None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:15.137219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6267ba7-0cb3-49fa-a282-c9aae0d7676a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:15.139609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 71/131] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:14 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:15.140808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6267ba7-0cb3-49fa-a282-c9aae0d7676a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:15.191716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:15.194926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd046a-2270-4e31-8b81-23d2e1104785 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:15.262561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654603-faa2-4fd6-8314-000cc1b3bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:15.263732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654603-faa2-4fd6-8314-000cc1b3bf5f None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.264348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654603-faa2-4fd6-8314-000cc1b3bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.264927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14654603-faa2-4fd6-8314-000cc1b3bf5f None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c/users/c3a3b12c08684d71aa48c75435606f10/roles/67ac8da7e16f46b496e98633276e6909` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.269314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14654603-faa2-4fd6-8314-000cc1b3bf5f None admin] RBAC: Authorizing `identity:create_grant(project_id=729d3dec279d497d9feb72ae57cadd8c, user_id=c3a3b12c08684d71aa48c75435606f10, role_id=67ac8da7e16f46b496e98633276e6909)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:15.272250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14654603-faa2-4fd6-8314-000cc1b3bf5f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:15.272774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6267ba7-0cb3-49fa-a282-c9aae0d7676a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:15.301620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 61/132] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:26:15 2022] PUT /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c/users/c3a3b12c08684d71aa48c75435606f10/roles/67ac8da7e16f46b496e98633276e6909 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:15.303309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654603-faa2-4fd6-8314-000cc1b3bf5f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:15.314653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321da9c5-6d6c-4827-8ff4-f53d26c134b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:15.315544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321da9c5-6d6c-4827-8ff4-f53d26c134b6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.315975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321da9c5-6d6c-4827-8ff4-f53d26c134b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.316458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321da9c5-6d6c-4827-8ff4-f53d26c134b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.317435 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321da9c5-6d6c-4827-8ff4-f53d26c134b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:15.317891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321da9c5-6d6c-4827-8ff4-f53d26c134b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:15.319510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321da9c5-6d6c-4827-8ff4-f53d26c134b6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:15.329109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 72/133] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:15.348020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321da9c5-6d6c-4827-8ff4-f53d26c134b6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:15.439138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:15.503655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14654603-faa2-4fd6-8314-000cc1b3bf5f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:15.540692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:15.556904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321da9c5-6d6c-4827-8ff4-f53d26c134b6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:15.564753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b08d4-70be-4c13-918d-9bed6ea33b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:15.565455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b08d4-70be-4c13-918d-9bed6ea33b55 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.565741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b08d4-70be-4c13-918d-9bed6ea33b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.566019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b08d4-70be-4c13-918d-9bed6ea33b55 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c/users/26d170ed749e495e8c4adc26cb1aaae7/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.574606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b08d4-70be-4c13-918d-9bed6ea33b55 None admin] RBAC: Authorizing `identity:create_grant(project_id=729d3dec279d497d9feb72ae57cadd8c, user_id=26d170ed749e495e8c4adc26cb1aaae7, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:15.576084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b08d4-70be-4c13-918d-9bed6ea33b55 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:15.599530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 62/134] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:26:15 2022] PUT /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c/users/26d170ed749e495e8c4adc26cb1aaae7/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:15.620870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f17aea-e8ce-4e9b-9b86-716361458a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:15.621663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f17aea-e8ce-4e9b-9b86-716361458a2f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.621957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f17aea-e8ce-4e9b-9b86-716361458a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.622242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f17aea-e8ce-4e9b-9b86-716361458a2f None admin] PATH_INFO: `/v3/users/c3a3b12c08684d71aa48c75435606f10` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.623593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f17aea-e8ce-4e9b-9b86-716361458a2f None admin] RBAC: Authorizing `identity:get_user(user_id=c3a3b12c08684d71aa48c75435606f10)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:15.625389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f17aea-e8ce-4e9b-9b86-716361458a2f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:15.627455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 73/135] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:15 2022] GET /identity/v3/users/c3a3b12c08684d71aa48c75435606f10 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:15.633571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b08d4-70be-4c13-918d-9bed6ea33b55 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:15.751391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b08d4-70be-4c13-918d-9bed6ea33b55 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:15.780287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:15.790410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d18bbb0-2cd8-4392-8afc-22d610322383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:15.791127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18bbb0-2cd8-4392-8afc-22d610322383 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.791417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18bbb0-2cd8-4392-8afc-22d610322383 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.791745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d18bbb0-2cd8-4392-8afc-22d610322383 None admin] PATH_INFO: `/v3/projects/8658ff8f2382431881e8dba8a967d512` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.793200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18bbb0-2cd8-4392-8afc-22d610322383 None admin] RBAC: Authorizing `identity:get_project(project_id=8658ff8f2382431881e8dba8a967d512)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:15.795096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d18bbb0-2cd8-4392-8afc-22d610322383 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:15.797541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 63/136] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:15 2022] GET /identity/v3/projects/8658ff8f2382431881e8dba8a967d512 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:15.803394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f17aea-e8ce-4e9b-9b86-716361458a2f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:15.914048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f17aea-e8ce-4e9b-9b86-716361458a2f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:15.947200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372b502-5193-4599-bd0e-73d1f3bec381 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.947537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372b502-5193-4599-bd0e-73d1f3bec381 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.947820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372b502-5193-4599-bd0e-73d1f3bec381 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.949388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 64/137] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:15.954375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09963e0d-dca7-4b5c-8903-440e601c45f4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.954667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09963e0d-dca7-4b5c-8903-440e601c45f4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.954949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09963e0d-dca7-4b5c-8903-440e601c45f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.977761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec8adb-c9dd-4085-8c82-ea9987f51168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:15.978460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec8adb-c9dd-4085-8c82-ea9987f51168 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:15.978746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec8adb-c9dd-4085-8c82-ea9987f51168 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:15.979026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec8adb-c9dd-4085-8c82-ea9987f51168 None admin] PATH_INFO: `/v3/projects/8658ff8f2382431881e8dba8a967d512/users/c3a3b12c08684d71aa48c75435606f10/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:15.983233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec8adb-c9dd-4085-8c82-ea9987f51168 None admin] RBAC: Authorizing `identity:create_grant(project_id=8658ff8f2382431881e8dba8a967d512, user_id=c3a3b12c08684d71aa48c75435606f10, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:15.988982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec8adb-c9dd-4085-8c82-ea9987f51168 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:15.992200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-09963e0d-dca7-4b5c-8903-440e601c45f4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:15.993604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-09963e0d-dca7-4b5c-8903-440e601c45f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:16.019784 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 74/138] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:26:15 2022] PUT /identity/v3/projects/8658ff8f2382431881e8dba8a967d512/users/c3a3b12c08684d71aa48c75435606f10/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:16.102594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 65/139] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 02 21:26:16.142808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec8adb-c9dd-4085-8c82-ea9987f51168 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:16.171228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:16.277643 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec8adb-c9dd-4085-8c82-ea9987f51168 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:16.316570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de95f6-0e23-4ae7-bace-1b1d3ae59d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:16.317236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de95f6-0e23-4ae7-bace-1b1d3ae59d2e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:16.317521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de95f6-0e23-4ae7-bace-1b1d3ae59d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:16.317801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de95f6-0e23-4ae7-bace-1b1d3ae59d2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:16.319041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de95f6-0e23-4ae7-bace-1b1d3ae59d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:16.321238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de95f6-0e23-4ae7-bace-1b1d3ae59d2e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:16.322905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 75/140] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:16.328461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09963e0d-dca7-4b5c-8903-440e601c45f4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:16.443365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09963e0d-dca7-4b5c-8903-440e601c45f4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:16.472893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:16.482259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d3d0d-9053-4012-bf73-5ab837cc4019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:16.483224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d3d0d-9053-4012-bf73-5ab837cc4019 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:16.483578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d3d0d-9053-4012-bf73-5ab837cc4019 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:16.484048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d3d0d-9053-4012-bf73-5ab837cc4019 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:16.484786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d3d0d-9053-4012-bf73-5ab837cc4019 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:16.486247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d3d0d-9053-4012-bf73-5ab837cc4019 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:16.524745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 66/141] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:16 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:17.286089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2ee80-5993-4d16-b2d7-18e7344a4856 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:17.286650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2ee80-5993-4d16-b2d7-18e7344a4856 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:17.286650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2ee80-5993-4d16-b2d7-18e7344a4856 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:17.288110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 76/142] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:17.297461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef54f3d-76f6-4775-8511-b5587f3260e7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:17.297888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef54f3d-76f6-4775-8511-b5587f3260e7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:17.298172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef54f3d-76f6-4775-8511-b5587f3260e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:17.321081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cef54f3d-76f6-4775-8511-b5587f3260e7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:17.322272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cef54f3d-76f6-4775-8511-b5587f3260e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:17.408903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 67/143] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:17.432338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2ee80-5993-4d16-b2d7-18e7344a4856 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:17.529135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:17.545957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2ee80-5993-4d16-b2d7-18e7344a4856 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:17.582515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a8ec5-1773-4645-a3f9-ae066e58b89f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:17.583218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a8ec5-1773-4645-a3f9-ae066e58b89f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:17.583501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a8ec5-1773-4645-a3f9-ae066e58b89f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:17.583774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a8ec5-1773-4645-a3f9-ae066e58b89f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:17.595810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a8ec5-1773-4645-a3f9-ae066e58b89f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8e3a8ec5-1773-4645-a3f9-ae066e58b89f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:17.601656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:17.602501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:17.603266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 77/144] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:17.609887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef54f3d-76f6-4775-8511-b5587f3260e7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:17.718500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef54f3d-76f6-4775-8511-b5587f3260e7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:17.732516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:17.755824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c3515-8288-4ae7-b716-6e51f303d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:17.756795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c3515-8288-4ae7-b716-6e51f303d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:17.757640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c3515-8288-4ae7-b716-6e51f303d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:17.757924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c3515-8288-4ae7-b716-6e51f303d7c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:17.758654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c3515-8288-4ae7-b716-6e51f303d7c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:17.758962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c3515-8288-4ae7-b716-6e51f303d7c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:17.760363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c3515-8288-4ae7-b716-6e51f303d7c1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:17.771196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 68/145] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:17.776909 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a8ec5-1773-4645-a3f9-ae066e58b89f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:17.883006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a8ec5-1773-4645-a3f9-ae066e58b89f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:17.917465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390484e-cccc-454e-a364-5dc96de8ec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:17.918109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390484e-cccc-454e-a364-5dc96de8ec93 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:17.918445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390484e-cccc-454e-a364-5dc96de8ec93 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:17.918768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6390484e-cccc-454e-a364-5dc96de8ec93 None admin] PATH_INFO: `/v3/users/da75272d23e9485d93ba11805e13d8ae` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:17.919922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390484e-cccc-454e-a364-5dc96de8ec93 None admin] RBAC: Authorizing `identity:get_user(user_id=da75272d23e9485d93ba11805e13d8ae)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:17.921444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6390484e-cccc-454e-a364-5dc96de8ec93 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:17.923109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 78/146] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:17 2022] GET /identity/v3/users/da75272d23e9485d93ba11805e13d8ae => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:17.928689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c3515-8288-4ae7-b716-6e51f303d7c1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:18.035843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c3515-8288-4ae7-b716-6e51f303d7c1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:18.071998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51796f6f-de56-4756-ad19-161eb0a2026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:18.072608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51796f6f-de56-4756-ad19-161eb0a2026a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:18.072939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51796f6f-de56-4756-ad19-161eb0a2026a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:18.073220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51796f6f-de56-4756-ad19-161eb0a2026a None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:18.074460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51796f6f-de56-4756-ad19-161eb0a2026a None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:18.075925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51796f6f-de56-4756-ad19-161eb0a2026a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:18.077926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 69/147] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:17 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:18.083819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390484e-cccc-454e-a364-5dc96de8ec93 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:18.101450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:18.192956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6390484e-cccc-454e-a364-5dc96de8ec93 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:18.227862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d76b6-2ba7-4d7c-a031-329a7483409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:18.228583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d76b6-2ba7-4d7c-a031-329a7483409e None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:18.229174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d76b6-2ba7-4d7c-a031-329a7483409e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:18.229588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d76b6-2ba7-4d7c-a031-329a7483409e None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c/users/da75272d23e9485d93ba11805e13d8ae/roles/e7456e6d5b404412ad235b2bfeb1df9b` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:18.232257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d76b6-2ba7-4d7c-a031-329a7483409e None admin] RBAC: Authorizing `identity:create_grant(project_id=729d3dec279d497d9feb72ae57cadd8c, user_id=da75272d23e9485d93ba11805e13d8ae, role_id=e7456e6d5b404412ad235b2bfeb1df9b)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:18.233730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d76b6-2ba7-4d7c-a031-329a7483409e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:18.251394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 79/148] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:26:18 2022] PUT /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c/users/da75272d23e9485d93ba11805e13d8ae/roles/e7456e6d5b404412ad235b2bfeb1df9b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:18.260205 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec30b-e313-49bb-8481-ca947a1e21ad None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:18.260801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec30b-e313-49bb-8481-ca947a1e21ad None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:18.261310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ec30b-e313-49bb-8481-ca947a1e21ad None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:18.263447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 70/149] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:18.273074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7b0e-7912-4133-aef0-31ce170c6ab7 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:18.273390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7b0e-7912-4133-aef0-31ce170c6ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:18.273637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa7b0e-7912-4133-aef0-31ce170c6ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:18.294377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d8aa7b0e-7912-4133-aef0-31ce170c6ab7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:18.295583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d8aa7b0e-7912-4133-aef0-31ce170c6ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:18.371496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 80/150] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:18.432023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ec30b-e313-49bb-8481-ca947a1e21ad None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:18.487650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:18.562048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ec30b-e313-49bb-8481-ca947a1e21ad None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:18.607651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a954b-375b-4998-9313-23c55b46bdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:18.608334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a954b-375b-4998-9313-23c55b46bdaa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:18.608619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a954b-375b-4998-9313-23c55b46bdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:18.608954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a954b-375b-4998-9313-23c55b46bdaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:18.622231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a954b-375b-4998-9313-23c55b46bdaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-fa1a954b-375b-4998-9313-23c55b46bdaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:18.627897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:18.628721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:18.629457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 71/151] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:18.636721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7b0e-7912-4133-aef0-31ce170c6ab7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:18.640469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:18.686504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c424a-2b3d-4e18-b2f2-485b121ac3f0 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:18.686794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c424a-2b3d-4e18-b2f2-485b121ac3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:18.687057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c424a-2b3d-4e18-b2f2-485b121ac3f0 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:18.689924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 72/152] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:18.695190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33315-a74d-47ad-ad11-2e83823c22bb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:18.695472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33315-a74d-47ad-ad11-2e83823c22bb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:18.695744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d33315-a74d-47ad-ad11-2e83823c22bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:18.728623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-36d33315-a74d-47ad-ad11-2e83823c22bb None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:18.731370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-36d33315-a74d-47ad-ad11-2e83823c22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:18.815429 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa7b0e-7912-4133-aef0-31ce170c6ab7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:18.837134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 73/153] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:18.870318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297a31a-eb4f-4a4f-8f61-0501321ee5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:18.870955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297a31a-eb4f-4a4f-8f61-0501321ee5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:18.871234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297a31a-eb4f-4a4f-8f61-0501321ee5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:18.871508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297a31a-eb4f-4a4f-8f61-0501321ee5a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:18.872321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297a31a-eb4f-4a4f-8f61-0501321ee5a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:18.872628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297a31a-eb4f-4a4f-8f61-0501321ee5a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:18.874207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33315-a74d-47ad-ad11-2e83823c22bb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:18.874322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297a31a-eb4f-4a4f-8f61-0501321ee5a7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:18.887807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 81/154] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:18.893441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297a31a-eb4f-4a4f-8f61-0501321ee5a7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:18.928613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:18.984508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:19.031300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d33315-a74d-47ad-ad11-2e83823c22bb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:19.082018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297a31a-eb4f-4a4f-8f61-0501321ee5a7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:19.087614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b9f55-5088-494a-86ae-03b4ad70d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:19.088304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b9f55-5088-494a-86ae-03b4ad70d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:19.088674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b9f55-5088-494a-86ae-03b4ad70d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:19.088956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b9f55-5088-494a-86ae-03b4ad70d4d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:19.111973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b9f55-5088-494a-86ae-03b4ad70d4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-287b9f55-5088-494a-86ae-03b4ad70d4d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:19.117188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:19.118013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:19.118955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 74/155] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:19.125924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b9f55-5088-494a-86ae-03b4ad70d4d7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:19.160052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb5082-2abd-4dd3-b8f1-5d9779d2fa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:19.160738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb5082-2abd-4dd3-b8f1-5d9779d2fa8e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:19.161021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb5082-2abd-4dd3-b8f1-5d9779d2fa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:19.161295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb5082-2abd-4dd3-b8f1-5d9779d2fa8e None admin] PATH_INFO: `/v3/users/c3a3b12c08684d71aa48c75435606f10` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:19.162488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb5082-2abd-4dd3-b8f1-5d9779d2fa8e None admin] RBAC: Authorizing `identity:get_user(user_id=c3a3b12c08684d71aa48c75435606f10)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:19.163991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb5082-2abd-4dd3-b8f1-5d9779d2fa8e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:19.166131 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 82/156] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:18 2022] GET /identity/v3/users/c3a3b12c08684d71aa48c75435606f10 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:19.177039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb5082-2abd-4dd3-b8f1-5d9779d2fa8e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:19.264549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:19.273435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b9f55-5088-494a-86ae-03b4ad70d4d7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:19.344841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbd8bc-88fb-4109-8f52-48a9eaf7835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:19.345477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbd8bc-88fb-4109-8f52-48a9eaf7835c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:19.345759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbd8bc-88fb-4109-8f52-48a9eaf7835c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:19.348748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbd8bc-88fb-4109-8f52-48a9eaf7835c None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:19.349528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbd8bc-88fb-4109-8f52-48a9eaf7835c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:19.349839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbd8bc-88fb-4109-8f52-48a9eaf7835c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:19.351293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbd8bc-88fb-4109-8f52-48a9eaf7835c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:19.373534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 75/157] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:19.378087 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbd8bc-88fb-4109-8f52-48a9eaf7835c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:19.413472 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb5082-2abd-4dd3-b8f1-5d9779d2fa8e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:19.497450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c36b53-caf5-41eb-a22e-44789642b83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:19.498091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36b53-caf5-41eb-a22e-44789642b83c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:19.498375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36b53-caf5-41eb-a22e-44789642b83c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:19.498660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36b53-caf5-41eb-a22e-44789642b83c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:19.506814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:19.583886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbd8bc-88fb-4109-8f52-48a9eaf7835c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:19.641837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c36b53-caf5-41eb-a22e-44789642b83c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:19.644669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c36b53-caf5-41eb-a22e-44789642b83c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:19.681056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f52a3-5b23-4627-9dd6-f65b15761e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:19.682431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f52a3-5b23-4627-9dd6-f65b15761e2e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:19.682969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f52a3-5b23-4627-9dd6-f65b15761e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:19.683657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f52a3-5b23-4627-9dd6-f65b15761e2e None admin] PATH_INFO: `/v3/users/c3a3b12c08684d71aa48c75435606f10` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:19.685266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f52a3-5b23-4627-9dd6-f65b15761e2e None admin] RBAC: Authorizing `identity:get_user(user_id=c3a3b12c08684d71aa48c75435606f10)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:19.687377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f52a3-5b23-4627-9dd6-f65b15761e2e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:19.689701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 76/158] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:19 2022] GET /identity/v3/users/c3a3b12c08684d71aa48c75435606f10 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:19.691214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb068266-411d-4c49-8175-d4a41609729a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:19.691783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb068266-411d-4c49-8175-d4a41609729a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:19.696446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb068266-411d-4c49-8175-d4a41609729a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:19.698278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 77/159] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:19.703651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7ca34-edaf-4705-b6b5-c2bb56285332 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:19.704204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7ca34-edaf-4705-b6b5-c2bb56285332 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:19.704699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7ca34-edaf-4705-b6b5-c2bb56285332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:19.741144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4ed7ca34-edaf-4705-b6b5-c2bb56285332 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:19.742691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4ed7ca34-edaf-4705-b6b5-c2bb56285332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:19.772560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:19.800229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 83/160] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:19.801209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c36b53-caf5-41eb-a22e-44789642b83c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:19.860493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:19.929589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 78/161] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:19.930380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7ca34-edaf-4705-b6b5-c2bb56285332 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:19.930940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c36b53-caf5-41eb-a22e-44789642b83c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:19.966534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ae849-3a2e-4dff-ae0d-0fa1b27c773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:19.967164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ae849-3a2e-4dff-ae0d-0fa1b27c773d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:19.967447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ae849-3a2e-4dff-ae0d-0fa1b27c773d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:19.967769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ae849-3a2e-4dff-ae0d-0fa1b27c773d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:20.037945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ae849-3a2e-4dff-ae0d-0fa1b27c773d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:20.039502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ae849-3a2e-4dff-ae0d-0fa1b27c773d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:20.093917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:20.193760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 84/162] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:20.195390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ae849-3a2e-4dff-ae0d-0fa1b27c773d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:20.298318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7ca34-edaf-4705-b6b5-c2bb56285332 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:20.371409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ae849-3a2e-4dff-ae0d-0fa1b27c773d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:20.401402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c4328-3d3d-4d03-b172-e25934b05cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:20.402075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c4328-3d3d-4d03-b172-e25934b05cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:20.402358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c4328-3d3d-4d03-b172-e25934b05cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:20.402627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c4328-3d3d-4d03-b172-e25934b05cc7 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:20.406513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c4328-3d3d-4d03-b172-e25934b05cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:20.407975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87c4328-3d3d-4d03-b172-e25934b05cc7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:20.409690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 79/163] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:19 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:20.410831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91864-5beb-442a-af0f-cad07741621e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:20.411114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91864-5beb-442a-af0f-cad07741621e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:20.411388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91864-5beb-442a-af0f-cad07741621e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:20.412640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 80/164] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:20.413866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91864-5beb-442a-af0f-cad07741621e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:20.441430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d7216-4c24-4f6d-b3f2-afa56beea57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:20.442074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7216-4c24-4f6d-b3f2-afa56beea57d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:20.442353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7216-4c24-4f6d-b3f2-afa56beea57d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:20.442626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7216-4c24-4f6d-b3f2-afa56beea57d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:20.446922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:20.460538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:20.467453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d7216-4c24-4f6d-b3f2-afa56beea57d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-610d7216-4c24-4f6d-b3f2-afa56beea57d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:20.472851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:20.473767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:20.474561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:20.478681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 85/165] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:20.479607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d7216-4c24-4f6d-b3f2-afa56beea57d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:20.627012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d7216-4c24-4f6d-b3f2-afa56beea57d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:20.636797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91864-5beb-442a-af0f-cad07741621e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:20.675380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f754ed9-366f-466b-80f5-b8e046422827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:20.676590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f754ed9-366f-466b-80f5-b8e046422827 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:20.676879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f754ed9-366f-466b-80f5-b8e046422827 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:20.677159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f754ed9-366f-466b-80f5-b8e046422827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:20.678037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f754ed9-366f-466b-80f5-b8e046422827 None admin] RBAC: Adding query filter params (role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=729d3dec279d497d9feb72ae57cadd8c, user.id=c3a3b12c08684d71aa48c75435606f10) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:20.678363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f754ed9-366f-466b-80f5-b8e046422827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:20.680907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f754ed9-366f-466b-80f5-b8e046422827 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:20.693293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 86/166] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:20 2022] GET /identity/v3/role_assignments?user.id=c3a3b12c08684d71aa48c75435606f10&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:20.694928 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075a793-e28a-4d93-ba11-7a6aff4937c8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:20.695215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075a793-e28a-4d93-ba11-7a6aff4937c8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:20.695490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4075a793-e28a-4d93-ba11-7a6aff4937c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:20.737059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4075a793-e28a-4d93-ba11-7a6aff4937c8 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:20.738323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4075a793-e28a-4d93-ba11-7a6aff4937c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:20.748589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23146b-9126-4883-b4fb-2c17b6bf0859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:20.749247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23146b-9126-4883-b4fb-2c17b6bf0859 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:20.749532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23146b-9126-4883-b4fb-2c17b6bf0859 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:20.749806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a23146b-9126-4883-b4fb-2c17b6bf0859 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:20.752000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23146b-9126-4883-b4fb-2c17b6bf0859 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:20.753215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a23146b-9126-4883-b4fb-2c17b6bf0859 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:20.755038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 81/167] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:20 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:20.755690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23146b-9126-4883-b4fb-2c17b6bf0859 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:20.876630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:20.926508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 87/168] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:20.927896 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d038f2-454c-4028-9a65-feb9c52c62c7 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:20.928214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d038f2-454c-4028-9a65-feb9c52c62c7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:20.928496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d038f2-454c-4028-9a65-feb9c52c62c7 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:20.930078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 88/169] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:20.930798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d038f2-454c-4028-9a65-feb9c52c62c7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:20.944526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:20.982337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a23146b-9126-4883-b4fb-2c17b6bf0859 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:21.050356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000b76-132e-4732-a430-be21382a50e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:21.050994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000b76-132e-4732-a430-be21382a50e6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.051275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000b76-132e-4732-a430-be21382a50e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.051546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000b76-132e-4732-a430-be21382a50e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.052307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88000b76-132e-4732-a430-be21382a50e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:21.052613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88000b76-132e-4732-a430-be21382a50e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:21.054047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88000b76-132e-4732-a430-be21382a50e6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:21.074613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 82/170] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:21.075906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3805d-73c0-40d5-9f32-adad3e7c3cd8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.081352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3805d-73c0-40d5-9f32-adad3e7c3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.081667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3805d-73c0-40d5-9f32-adad3e7c3cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.116212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-75b3805d-73c0-40d5-9f32-adad3e7c3cd8 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:21.117395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-75b3805d-73c0-40d5-9f32-adad3e7c3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:21.144817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d038f2-454c-4028-9a65-feb9c52c62c7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:21.204264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254b6a0-c92d-4d95-81b6-3d487c38897b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:21.204897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254b6a0-c92d-4d95-81b6-3d487c38897b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.205177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254b6a0-c92d-4d95-81b6-3d487c38897b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.205448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254b6a0-c92d-4d95-81b6-3d487c38897b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.206252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254b6a0-c92d-4d95-81b6-3d487c38897b None admin] RBAC: Adding query filter params (role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=729d3dec279d497d9feb72ae57cadd8c, user.id=c3a3b12c08684d71aa48c75435606f10) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:21.206621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254b6a0-c92d-4d95-81b6-3d487c38897b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:21.208099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254b6a0-c92d-4d95-81b6-3d487c38897b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:21.221789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 89/171] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:20 2022] GET /identity/v3/role_assignments?user.id=c3a3b12c08684d71aa48c75435606f10&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=67ac8da7e16f46b496e98633276e6909 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:21.222640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254b6a0-c92d-4d95-81b6-3d487c38897b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:21.257820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 83/172] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:21.258707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3805d-73c0-40d5-9f32-adad3e7c3cd8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:21.330073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:21.400658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254b6a0-c92d-4d95-81b6-3d487c38897b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:21.432640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:21.451552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e3f1-2ed4-4f4d-922c-25e0188e607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:21.461510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e3f1-2ed4-4f4d-922c-25e0188e607a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.462020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e3f1-2ed4-4f4d-922c-25e0188e607a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.462337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281e3f1-2ed4-4f4d-922c-25e0188e607a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.486231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281e3f1-2ed4-4f4d-922c-25e0188e607a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-1281e3f1-2ed4-4f4d-922c-25e0188e607a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:21.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:21.495564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:21.496355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:21.501543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 90/173] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:21.502776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e3f1-2ed4-4f4d-922c-25e0188e607a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:21.520121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3805d-73c0-40d5-9f32-adad3e7c3cd8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:21.591152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170253c8-93bc-48c5-a12a-80ace1aef557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:21.591724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170253c8-93bc-48c5-a12a-80ace1aef557 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.592067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170253c8-93bc-48c5-a12a-80ace1aef557 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.592439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170253c8-93bc-48c5-a12a-80ace1aef557 None admin] PATH_INFO: `/v3/users/26d170ed749e495e8c4adc26cb1aaae7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.594292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170253c8-93bc-48c5-a12a-80ace1aef557 None admin] RBAC: Authorizing `identity:get_user(user_id=26d170ed749e495e8c4adc26cb1aaae7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:21.595771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170253c8-93bc-48c5-a12a-80ace1aef557 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:21.597420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 84/174] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:21 2022] GET /identity/v3/users/26d170ed749e495e8c4adc26cb1aaae7 => generated 247 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:21.598191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170253c8-93bc-48c5-a12a-80ace1aef557 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:21.653018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281e3f1-2ed4-4f4d-922c-25e0188e607a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:21.672543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:21.692999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3a3c5-e971-4fc9-811e-d8fb8b169a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:21.693198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a3c5-e971-4fc9-811e-d8fb8b169a38 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.693453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a3c5-e971-4fc9-811e-d8fb8b169a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.693732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a3c5-e971-4fc9-811e-d8fb8b169a38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.706455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3a3c5-e971-4fc9-811e-d8fb8b169a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-2bc3a3c5-e971-4fc9-811e-d8fb8b169a38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:21.712094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:21.712993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:21.713766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:21.714330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 91/175] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:21.715544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a46a4-fe0a-40c2-b733-fd2cf3f61ad1 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.715834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a46a4-fe0a-40c2-b733-fd2cf3f61ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.716111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a46a4-fe0a-40c2-b733-fd2cf3f61ad1 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.717391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 92/176] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:21.720314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a46a4-fe0a-40c2-b733-fd2cf3f61ad1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:21.750610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170253c8-93bc-48c5-a12a-80ace1aef557 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:21.799036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeeb27-f802-4ce6-9e3a-ea41bec73759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:21.800011 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeeb27-f802-4ce6-9e3a-ea41bec73759 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.800637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeeb27-f802-4ce6-9e3a-ea41bec73759 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.801120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeeeb27-f802-4ce6-9e3a-ea41bec73759 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.802057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeeb27-f802-4ce6-9e3a-ea41bec73759 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:21.802565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeeb27-f802-4ce6-9e3a-ea41bec73759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:21.804210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeeeb27-f802-4ce6-9e3a-ea41bec73759 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:21.814627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 85/177] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:21.815893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeeb27-f802-4ce6-9e3a-ea41bec73759 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:21.831052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:21.848309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a46a4-fe0a-40c2-b733-fd2cf3f61ad1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:21.881313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287ad2e-db8a-477f-8af0-6fb474d4af45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:21.882519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287ad2e-db8a-477f-8af0-6fb474d4af45 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.882801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287ad2e-db8a-477f-8af0-6fb474d4af45 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.883075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287ad2e-db8a-477f-8af0-6fb474d4af45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.920793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeeeb27-f802-4ce6-9e3a-ea41bec73759 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:21.923060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:21.949792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287ad2e-db8a-477f-8af0-6fb474d4af45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:21.951284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4287ad2e-db8a-477f-8af0-6fb474d4af45 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:21.954568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcff65-d8b4-4849-ba10-f04312d730f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:21.955200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcff65-d8b4-4849-ba10-f04312d730f5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.955481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcff65-d8b4-4849-ba10-f04312d730f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.955749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcff65-d8b4-4849-ba10-f04312d730f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.956485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcff65-d8b4-4849-ba10-f04312d730f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:21.956789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcff65-d8b4-4849-ba10-f04312d730f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:21.958136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcff65-d8b4-4849-ba10-f04312d730f5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:21.966917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 86/178] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:21.972605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699beda-fb4b-4d01-80b6-0f193a1ce889 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:21.972892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699beda-fb4b-4d01-80b6-0f193a1ce889 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:21.973169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699beda-fb4b-4d01-80b6-0f193a1ce889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:21.990543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8699beda-fb4b-4d01-80b6-0f193a1ce889 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:21.992056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8699beda-fb4b-4d01-80b6-0f193a1ce889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:22.051138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 93/179] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:22.052427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1489-61d2-4eee-82f6-c7d7a832783f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.052884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1489-61d2-4eee-82f6-c7d7a832783f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.052989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb1489-61d2-4eee-82f6-c7d7a832783f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.056170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 94/180] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:22.056170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1489-61d2-4eee-82f6-c7d7a832783f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.064666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 87/181] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:22.065894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96274a-ac64-4b6c-9992-5f78bdbf2397 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.066553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96274a-ac64-4b6c-9992-5f78bdbf2397 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.066832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96274a-ac64-4b6c-9992-5f78bdbf2397 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.068483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 88/182] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:22.070157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96274a-ac64-4b6c-9992-5f78bdbf2397 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.072595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:22.131611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:22.162454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb1489-61d2-4eee-82f6-c7d7a832783f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:22.171054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96274a-ac64-4b6c-9992-5f78bdbf2397 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:22.194924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380581a0-07b3-46fe-85be-afd3be38d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:22.195555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380581a0-07b3-46fe-85be-afd3be38d983 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.195840 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380581a0-07b3-46fe-85be-afd3be38d983 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.196107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380581a0-07b3-46fe-85be-afd3be38d983 None admin] PATH_INFO: `/v3/users/c3a3b12c08684d71aa48c75435606f10` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.197350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380581a0-07b3-46fe-85be-afd3be38d983 None admin] RBAC: Authorizing `identity:get_user(user_id=c3a3b12c08684d71aa48c75435606f10)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:22.198893 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380581a0-07b3-46fe-85be-afd3be38d983 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:22.200838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 95/183] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/users/c3a3b12c08684d71aa48c75435606f10 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:22.201623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380581a0-07b3-46fe-85be-afd3be38d983 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.204152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0762f4-9a4c-4418-a1cf-9f8b30b9547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:22.205375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0762f4-9a4c-4418-a1cf-9f8b30b9547c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.205375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0762f4-9a4c-4418-a1cf-9f8b30b9547c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.205375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0762f4-9a4c-4418-a1cf-9f8b30b9547c None admin] PATH_INFO: `/v3/users/2fa4a4adf10c4a628567a904e967b359` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.219234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0762f4-9a4c-4418-a1cf-9f8b30b9547c None admin] RBAC: Authorizing `identity:get_user(user_id=2fa4a4adf10c4a628567a904e967b359)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:22.220718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0762f4-9a4c-4418-a1cf-9f8b30b9547c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:22.222357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 89/184] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/users/2fa4a4adf10c4a628567a904e967b359 => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:22.223507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902aeb8-5b47-4b16-a082-74439be0c694 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.223787 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902aeb8-5b47-4b16-a082-74439be0c694 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.224061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902aeb8-5b47-4b16-a082-74439be0c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.240903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8902aeb8-5b47-4b16-a082-74439be0c694 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:22.242593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8902aeb8-5b47-4b16-a082-74439be0c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:22.307492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:22.319236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 90/185] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:22.320436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380581a0-07b3-46fe-85be-afd3be38d983 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:22.321125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197ebba-a7a0-4dfa-aa10-cca2032040d0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.321413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197ebba-a7a0-4dfa-aa10-cca2032040d0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.321688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197ebba-a7a0-4dfa-aa10-cca2032040d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.339334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3197ebba-a7a0-4dfa-aa10-cca2032040d0 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:22.340552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3197ebba-a7a0-4dfa-aa10-cca2032040d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:22.357927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759dedb-277d-45d3-b4e2-a5f4c3d5b893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:22.358556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759dedb-277d-45d3-b4e2-a5f4c3d5b893 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.358829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759dedb-277d-45d3-b4e2-a5f4c3d5b893 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.359095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759dedb-277d-45d3-b4e2-a5f4c3d5b893 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.360266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759dedb-277d-45d3-b4e2-a5f4c3d5b893 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:22.361714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c759dedb-277d-45d3-b4e2-a5f4c3d5b893 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:22.363364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 96/186] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:22.364215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759dedb-277d-45d3-b4e2-a5f4c3d5b893 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.375555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:22.409762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 91/187] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:22.410605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197ebba-a7a0-4dfa-aa10-cca2032040d0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.479009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759dedb-277d-45d3-b4e2-a5f4c3d5b893 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:22.509314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197ebba-a7a0-4dfa-aa10-cca2032040d0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:22.512463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3f19-584d-4942-9fa5-cb8502a054a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:22.513107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3f19-584d-4942-9fa5-cb8502a054a1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.513387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3f19-584d-4942-9fa5-cb8502a054a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.513657 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55af3f19-584d-4942-9fa5-cb8502a054a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.523430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55af3f19-584d-4942-9fa5-cb8502a054a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-55af3f19-584d-4942-9fa5-cb8502a054a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:22.528363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:22.529469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 97/188] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:22.530732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3f19-584d-4942-9fa5-cb8502a054a1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.531944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:22.546700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3983317-407c-4eed-bd33-adbc6795e83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:22.547321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3983317-407c-4eed-bd33-adbc6795e83b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.547601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3983317-407c-4eed-bd33-adbc6795e83b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.547874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3983317-407c-4eed-bd33-adbc6795e83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.595090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:22.615784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3983317-407c-4eed-bd33-adbc6795e83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:22.617929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3983317-407c-4eed-bd33-adbc6795e83b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:22.628328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55af3f19-584d-4942-9fa5-cb8502a054a1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:22.664031 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251eb4b-cec5-4cc0-91e4-024562cd2b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:22.664594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251eb4b-cec5-4cc0-91e4-024562cd2b8f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.664877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251eb4b-cec5-4cc0-91e4-024562cd2b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.665141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251eb4b-cec5-4cc0-91e4-024562cd2b8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.720077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 92/189] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:22.720935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3983317-407c-4eed-bd33-adbc6795e83b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.731648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251eb4b-cec5-4cc0-91e4-024562cd2b8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:22.733164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251eb4b-cec5-4cc0-91e4-024562cd2b8f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:22.741782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:22.795362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:22.822994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3983317-407c-4eed-bd33-adbc6795e83b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:22.830441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 98/190] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:22.831266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251eb4b-cec5-4cc0-91e4-024562cd2b8f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.858855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef9a2-af3f-4670-a107-d1d67a2b8ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:22.859596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef9a2-af3f-4670-a107-d1d67a2b8ebb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.859943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef9a2-af3f-4670-a107-d1d67a2b8ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.860258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ef9a2-af3f-4670-a107-d1d67a2b8ebb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.871451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ef9a2-af3f-4670-a107-d1d67a2b8ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-7c6ef9a2-af3f-4670-a107-d1d67a2b8ebb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:22.876489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:22.877526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:22.878306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 93/191] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:22.878946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef9a2-af3f-4670-a107-d1d67a2b8ebb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.929667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251eb4b-cec5-4cc0-91e4-024562cd2b8f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:22.965018 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:22.970678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea7996-9ac4-444b-8958-2402131cc60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:22.971292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea7996-9ac4-444b-8958-2402131cc60a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:22.971564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea7996-9ac4-444b-8958-2402131cc60a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:22.971834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea7996-9ac4-444b-8958-2402131cc60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:22.972647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea7996-9ac4-444b-8958-2402131cc60a None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=729d3dec279d497d9feb72ae57cadd8c, user.id=26d170ed749e495e8c4adc26cb1aaae7) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:22.972955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea7996-9ac4-444b-8958-2402131cc60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:22.974416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea7996-9ac4-444b-8958-2402131cc60a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:22.980292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 99/192] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/role_assignments?user.id=26d170ed749e495e8c4adc26cb1aaae7&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:22.981056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea7996-9ac4-444b-8958-2402131cc60a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:22.984938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ef9a2-af3f-4670-a107-d1d67a2b8ebb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.024678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed00ee-e93c-4fcb-98d9-6a2b98869631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.025616 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed00ee-e93c-4fcb-98d9-6a2b98869631 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.026054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed00ee-e93c-4fcb-98d9-6a2b98869631 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.026326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed00ee-e93c-4fcb-98d9-6a2b98869631 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.026636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:23.027584 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed00ee-e93c-4fcb-98d9-6a2b98869631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.029313 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed00ee-e93c-4fcb-98d9-6a2b98869631 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.031306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 94/193] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:23.037062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed00ee-e93c-4fcb-98d9-6a2b98869631 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.106846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea7996-9ac4-444b-8958-2402131cc60a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.147890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf012ff9-ab43-4890-8c65-dfd31a880fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.148554 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf012ff9-ab43-4890-8c65-dfd31a880fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.148845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf012ff9-ab43-4890-8c65-dfd31a880fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.149120 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf012ff9-ab43-4890-8c65-dfd31a880fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.149770 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed00ee-e93c-4fcb-98d9-6a2b98869631 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.149872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf012ff9-ab43-4890-8c65-dfd31a880fd4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:23.150140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf012ff9-ab43-4890-8c65-dfd31a880fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.152414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf012ff9-ab43-4890-8c65-dfd31a880fd4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.161251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 100/194] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:23.162734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf012ff9-ab43-4890-8c65-dfd31a880fd4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.195553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d71c50-1a99-45c3-aa22-b3b48c674a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.196191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d71c50-1a99-45c3-aa22-b3b48c674a80 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.196481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d71c50-1a99-45c3-aa22-b3b48c674a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.197309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d71c50-1a99-45c3-aa22-b3b48c674a80 None admin] PATH_INFO: `/v3/projects/8658ff8f2382431881e8dba8a967d512` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.197940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d71c50-1a99-45c3-aa22-b3b48c674a80 None admin] RBAC: Authorizing `identity:get_project(project_id=8658ff8f2382431881e8dba8a967d512)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.201054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d71c50-1a99-45c3-aa22-b3b48c674a80 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.202734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 95/195] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:23 2022] GET /identity/v3/projects/8658ff8f2382431881e8dba8a967d512 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:23.203681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d71c50-1a99-45c3-aa22-b3b48c674a80 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.221699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:23.274624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:23.282201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf012ff9-ab43-4890-8c65-dfd31a880fd4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.301509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d71c50-1a99-45c3-aa22-b3b48c674a80 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.315111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a28ce7-2efe-4a28-b0b8-0d103c19009b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.315963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28ce7-2efe-4a28-b0b8-0d103c19009b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.316279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28ce7-2efe-4a28-b0b8-0d103c19009b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.316558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28ce7-2efe-4a28-b0b8-0d103c19009b None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.317725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a28ce7-2efe-4a28-b0b8-0d103c19009b None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.319801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a28ce7-2efe-4a28-b0b8-0d103c19009b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.326456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 101/196] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:23 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:23.326456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a28ce7-2efe-4a28-b0b8-0d103c19009b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.335156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0295a-c64a-4deb-bf89-cc18e6e47fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.335766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0295a-c64a-4deb-bf89-cc18e6e47fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.336042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0295a-c64a-4deb-bf89-cc18e6e47fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.336337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0295a-c64a-4deb-bf89-cc18e6e47fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.337046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0295a-c64a-4deb-bf89-cc18e6e47fd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:23.337348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0295a-c64a-4deb-bf89-cc18e6e47fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.338693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f0295a-c64a-4deb-bf89-cc18e6e47fd1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.346796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 96/197] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:23.347583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0295a-c64a-4deb-bf89-cc18e6e47fd1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.423603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:23.424332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a28ce7-2efe-4a28-b0b8-0d103c19009b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.444374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f0295a-c64a-4deb-bf89-cc18e6e47fd1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.458055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f1887-adb8-43cc-92f7-2d66cef271f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.458685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f1887-adb8-43cc-92f7-2d66cef271f5 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.458993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f1887-adb8-43cc-92f7-2d66cef271f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.459263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f1887-adb8-43cc-92f7-2d66cef271f5 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.459945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f1887-adb8-43cc-92f7-2d66cef271f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.461517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f1887-adb8-43cc-92f7-2d66cef271f5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.478112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270c179-3c2e-4a2a-8577-4808218eedea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.478786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c179-3c2e-4a2a-8577-4808218eedea None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.479066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c179-3c2e-4a2a-8577-4808218eedea None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.479342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d270c179-3c2e-4a2a-8577-4808218eedea None admin] PATH_INFO: `/v3/users/2fa4a4adf10c4a628567a904e967b359` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.480613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270c179-3c2e-4a2a-8577-4808218eedea None admin] RBAC: Authorizing `identity:get_user(user_id=2fa4a4adf10c4a628567a904e967b359)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.482053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d270c179-3c2e-4a2a-8577-4808218eedea None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.482466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 102/198] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:23 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:23.483284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f1887-adb8-43cc-92f7-2d66cef271f5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.488501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 97/199] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:23 2022] GET /identity/v3/users/2fa4a4adf10c4a628567a904e967b359 => generated 283 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:23.488501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270c179-3c2e-4a2a-8577-4808218eedea None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.512172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:23.606853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d270c179-3c2e-4a2a-8577-4808218eedea None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.608806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f1887-adb8-43cc-92f7-2d66cef271f5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.642530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911b392-b54b-443f-a8f8-f303f4c26f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.643138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911b392-b54b-443f-a8f8-f303f4c26f5d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.643416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911b392-b54b-443f-a8f8-f303f4c26f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.643687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911b392-b54b-443f-a8f8-f303f4c26f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.644892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911b392-b54b-443f-a8f8-f303f4c26f5d None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=b2306424887947e5938736c5bbfeabb6, user.id=2fa4a4adf10c4a628567a904e967b359) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:23.644892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911b392-b54b-443f-a8f8-f303f4c26f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.646256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b911b392-b54b-443f-a8f8-f303f4c26f5d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.648719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14041cdf-5647-4a9e-b7c7-d55308bdeba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.649334 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14041cdf-5647-4a9e-b7c7-d55308bdeba7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.649619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14041cdf-5647-4a9e-b7c7-d55308bdeba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.649891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14041cdf-5647-4a9e-b7c7-d55308bdeba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.650691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14041cdf-5647-4a9e-b7c7-d55308bdeba7 None admin] RBAC: Adding query filter params (role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=8658ff8f2382431881e8dba8a967d512, user.id=c3a3b12c08684d71aa48c75435606f10) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:23.651003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14041cdf-5647-4a9e-b7c7-d55308bdeba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.652504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14041cdf-5647-4a9e-b7c7-d55308bdeba7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.653067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 98/200] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:23 2022] GET /identity/v3/role_assignments?user.id=2fa4a4adf10c4a628567a904e967b359&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:23.654608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911b392-b54b-443f-a8f8-f303f4c26f5d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.661168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 103/201] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:23 2022] GET /identity/v3/role_assignments?user.id=c3a3b12c08684d71aa48c75435606f10&scope.project.id=8658ff8f2382431881e8dba8a967d512&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:23.661942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14041cdf-5647-4a9e-b7c7-d55308bdeba7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.674192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:23.813524 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:23.819744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911b392-b54b-443f-a8f8-f303f4c26f5d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.849565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14041cdf-5647-4a9e-b7c7-d55308bdeba7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:23.874389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dd340-7ac5-46e3-b1b7-f88808ae3b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.875052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dd340-7ac5-46e3-b1b7-f88808ae3b64 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.875316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dd340-7ac5-46e3-b1b7-f88808ae3b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.875584 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dd340-7ac5-46e3-b1b7-f88808ae3b64 None admin] PATH_INFO: `/v3/users/da75272d23e9485d93ba11805e13d8ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.876809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2dd340-7ac5-46e3-b1b7-f88808ae3b64 None admin] RBAC: Authorizing `identity:get_user(user_id=da75272d23e9485d93ba11805e13d8ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.878882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2dd340-7ac5-46e3-b1b7-f88808ae3b64 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:23.879924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 99/202] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:23 2022] GET /identity/v3/users/da75272d23e9485d93ba11805e13d8ae => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:23.886818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dd340-7ac5-46e3-b1b7-f88808ae3b64 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:23.904342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9cd76-3eb0-438a-8894-afd87d03bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:23.905965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9cd76-3eb0-438a-8894-afd87d03bc93 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:23.906418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9cd76-3eb0-438a-8894-afd87d03bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:23.906839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9cd76-3eb0-438a-8894-afd87d03bc93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:23.996759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9cd76-3eb0-438a-8894-afd87d03bc93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:23.998898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9cd76-3eb0-438a-8894-afd87d03bc93 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:24.004488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:24.034890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dd340-7ac5-46e3-b1b7-f88808ae3b64 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:24.083018 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db4dbb-e4a3-41e8-952e-d0effdbe61ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:24.084183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db4dbb-e4a3-41e8-952e-d0effdbe61ab None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:24.084687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db4dbb-e4a3-41e8-952e-d0effdbe61ab None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:24.085703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db4dbb-e4a3-41e8-952e-d0effdbe61ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:24.141187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:24.179034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 104/203] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:24.185227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9cd76-3eb0-438a-8894-afd87d03bc93 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:24.215854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db4dbb-e4a3-41e8-952e-d0effdbe61ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:24.217706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db4dbb-e4a3-41e8-952e-d0effdbe61ab None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:24.305516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:24.332671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 100/204] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 21:26:24.338893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db4dbb-e4a3-41e8-952e-d0effdbe61ab None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:24.369481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9cd76-3eb0-438a-8894-afd87d03bc93 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:24.455629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db4dbb-e4a3-41e8-952e-d0effdbe61ab None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:24.456893 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f55102-25cd-438d-ba5f-6d3397981d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:24.457586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f55102-25cd-438d-ba5f-6d3397981d09 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:24.457864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f55102-25cd-438d-ba5f-6d3397981d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:24.458204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f55102-25cd-438d-ba5f-6d3397981d09 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:24.460783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f55102-25cd-438d-ba5f-6d3397981d09 None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:24.461646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f55102-25cd-438d-ba5f-6d3397981d09 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:24.463420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 105/205] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:24 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:24.469257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f55102-25cd-438d-ba5f-6d3397981d09 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:24.499331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5613379-ac6f-4ee1-9a34-e9db71458399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:24.500515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5613379-ac6f-4ee1-9a34-e9db71458399 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:24.500998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5613379-ac6f-4ee1-9a34-e9db71458399 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:24.501467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5613379-ac6f-4ee1-9a34-e9db71458399 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:24.503615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5613379-ac6f-4ee1-9a34-e9db71458399 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:24.505307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5613379-ac6f-4ee1-9a34-e9db71458399 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:24.508091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 101/206] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:24 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:24.513895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5613379-ac6f-4ee1-9a34-e9db71458399 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:24.586862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:24.601202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:24.673916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5613379-ac6f-4ee1-9a34-e9db71458399 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:24.706391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f55102-25cd-438d-ba5f-6d3397981d09 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:24.733221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204017eb-30f5-4198-8321-d53ce6d68e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:24.734227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204017eb-30f5-4198-8321-d53ce6d68e87 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:24.734755 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204017eb-30f5-4198-8321-d53ce6d68e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:24.735244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204017eb-30f5-4198-8321-d53ce6d68e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:24.736337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204017eb-30f5-4198-8321-d53ce6d68e87 None admin] RBAC: Adding query filter params (role.id=e7456e6d5b404412ad235b2bfeb1df9b, scope.project.id=729d3dec279d497d9feb72ae57cadd8c, user.id=da75272d23e9485d93ba11805e13d8ae) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:24.736910 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204017eb-30f5-4198-8321-d53ce6d68e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:24.738707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204017eb-30f5-4198-8321-d53ce6d68e87 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:24.745881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 102/207] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:24 2022] GET /identity/v3/role_assignments?user.id=da75272d23e9485d93ba11805e13d8ae&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=e7456e6d5b404412ad235b2bfeb1df9b => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:24.790575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c3388-6c82-4630-92be-31a028e671fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:24.791202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3388-6c82-4630-92be-31a028e671fe None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:24.791486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3388-6c82-4630-92be-31a028e671fe None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:24.791762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3388-6c82-4630-92be-31a028e671fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:24.792594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3388-6c82-4630-92be-31a028e671fe None admin] RBAC: Adding query filter params (role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=b2306424887947e5938736c5bbfeabb6, user.id=2fa4a4adf10c4a628567a904e967b359) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:24.792905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3388-6c82-4630-92be-31a028e671fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:24.794359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3388-6c82-4630-92be-31a028e671fe None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:24.809771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 106/208] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:24 2022] GET /identity/v3/role_assignments?user.id=2fa4a4adf10c4a628567a904e967b359&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=67ac8da7e16f46b496e98633276e6909 => generated 259 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:25.891552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35703b3d-cad4-44bc-8d2b-92b89374a790 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:25.892523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35703b3d-cad4-44bc-8d2b-92b89374a790 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:25.893024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35703b3d-cad4-44bc-8d2b-92b89374a790 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:25.894826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 103/209] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:25.900918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd90b-8fd9-43fc-8192-e5112e740a7d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:25.901713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd90b-8fd9-43fc-8192-e5112e740a7d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:25.902187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bd90b-8fd9-43fc-8192-e5112e740a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:25.921081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7b0bd90b-8fd9-43fc-8192-e5112e740a7d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:25.922633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7b0bd90b-8fd9-43fc-8192-e5112e740a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:25.977402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9da5d-d8ca-42d0-8e8b-c38e7282bdf7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:25.978007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9da5d-d8ca-42d0-8e8b-c38e7282bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:25.978477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b9da5d-d8ca-42d0-8e8b-c38e7282bdf7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:25.980054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 104/210] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:25.984950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce6e44-494b-4165-955f-cdc9d2fc81a1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:25.985395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce6e44-494b-4165-955f-cdc9d2fc81a1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:25.986318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cce6e44-494b-4165-955f-cdc9d2fc81a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.003587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 107/211] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:26.009222 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3cce6e44-494b-4165-955f-cdc9d2fc81a1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:26.010433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3cce6e44-494b-4165-955f-cdc9d2fc81a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:26.031205 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd90b-8fd9-43fc-8192-e5112e740a7d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.079022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:26.087412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 105/212] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:26.089085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94798c65-d4af-49a7-8f8e-32b3144a3800 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.089543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94798c65-d4af-49a7-8f8e-32b3144a3800 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.089962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94798c65-d4af-49a7-8f8e-32b3144a3800 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.095796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 106/213] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:26.097312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc15a0-ddef-4c59-bff4-c21250a193bc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.097730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc15a0-ddef-4c59-bff4-c21250a193bc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.098135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc15a0-ddef-4c59-bff4-c21250a193bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.117307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3efc15a0-ddef-4c59-bff4-c21250a193bc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:26.118690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3efc15a0-ddef-4c59-bff4-c21250a193bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:26.138714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bd90b-8fd9-43fc-8192-e5112e740a7d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:26.160258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:26.175684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2b837-3c02-4f22-9a68-29d4a8117d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:26.176347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2b837-3c02-4f22-9a68-29d4a8117d12 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.176627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2b837-3c02-4f22-9a68-29d4a8117d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.176897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2b837-3c02-4f22-9a68-29d4a8117d12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.187791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2b837-3c02-4f22-9a68-29d4a8117d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-aae2b837-3c02-4f22-9a68-29d4a8117d12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:26.192763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:26.193602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:26.194949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 108/214] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:26.195567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2b837-3c02-4f22-9a68-29d4a8117d12 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.197283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 107/215] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:26.200290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc15a0-ddef-4c59-bff4-c21250a193bc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.304311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc15a0-ddef-4c59-bff4-c21250a193bc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:26.323696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2b837-3c02-4f22-9a68-29d4a8117d12 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:26.327029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:26.342609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fac5f-c3f1-4dde-8490-33b6ec5b1363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:26.343442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fac5f-c3f1-4dde-8490-33b6ec5b1363 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.343730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fac5f-c3f1-4dde-8490-33b6ec5b1363 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.344002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fac5f-c3f1-4dde-8490-33b6ec5b1363 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.344743 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fac5f-c3f1-4dde-8490-33b6ec5b1363 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:26.345044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fac5f-c3f1-4dde-8490-33b6ec5b1363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:26.346811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fac5f-c3f1-4dde-8490-33b6ec5b1363 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:26.355971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 108/216] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:26.360301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fac5f-c3f1-4dde-8490-33b6ec5b1363 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.366619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20451d-e167-445b-861a-a5d0093b2a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:26.367270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20451d-e167-445b-861a-a5d0093b2a1e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.367555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20451d-e167-445b-861a-a5d0093b2a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.367829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20451d-e167-445b-861a-a5d0093b2a1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.369706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20451d-e167-445b-861a-a5d0093b2a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:26.371164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20451d-e167-445b-861a-a5d0093b2a1e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:26.372864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 109/217] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:26.373540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20451d-e167-445b-861a-a5d0093b2a1e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.393383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:26.465295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fac5f-c3f1-4dde-8490-33b6ec5b1363 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:26.480334 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20451d-e167-445b-861a-a5d0093b2a1e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:26.499229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba0a47-631a-4ff0-a7e0-3b3605192b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:26.499868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0a47-631a-4ff0-a7e0-3b3605192b99 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.500156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0a47-631a-4ff0-a7e0-3b3605192b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.500435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0a47-631a-4ff0-a7e0-3b3605192b99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.511379 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba0a47-631a-4ff0-a7e0-3b3605192b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:26.516369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bee1-5c0b-42f0-aa3d-1876a0eb5071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-11ba0a47-631a-4ff0-a7e0-3b3605192b99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:26.516778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:26.517630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:26.518395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:26.518959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bee1-5c0b-42f0-aa3d-1876a0eb5071 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.518959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bee1-5c0b-42f0-aa3d-1876a0eb5071 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.518959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3bee1-5c0b-42f0-aa3d-1876a0eb5071 None admin] PATH_INFO: `/v3/users/2fa4a4adf10c4a628567a904e967b359` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.519126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 109/218] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:26.519126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba0a47-631a-4ff0-a7e0-3b3605192b99 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.521207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3bee1-5c0b-42f0-aa3d-1876a0eb5071 None admin] RBAC: Authorizing `identity:get_user(user_id=2fa4a4adf10c4a628567a904e967b359)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:26.522707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3bee1-5c0b-42f0-aa3d-1876a0eb5071 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:26.524866 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 110/219] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:26 2022] GET /identity/v3/users/2fa4a4adf10c4a628567a904e967b359 => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:26.525494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bee1-5c0b-42f0-aa3d-1876a0eb5071 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.572792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:26.620470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:26.630286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba0a47-631a-4ff0-a7e0-3b3605192b99 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:26.634461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3bee1-5c0b-42f0-aa3d-1876a0eb5071 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:26.667237 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5e2f0-b648-4bf4-9aab-62afacb59461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:26.667857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5e2f0-b648-4bf4-9aab-62afacb59461 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.668171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5e2f0-b648-4bf4-9aab-62afacb59461 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.668458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d5e2f0-b648-4bf4-9aab-62afacb59461 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.669147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5e2f0-b648-4bf4-9aab-62afacb59461 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:26.669241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf0695-c31d-4293-ab58-cd592393063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:26.669865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf0695-c31d-4293-ab58-cd592393063f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.670143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf0695-c31d-4293-ab58-cd592393063f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.670412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf0695-c31d-4293-ab58-cd592393063f None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.670589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d5e2f0-b648-4bf4-9aab-62afacb59461 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:26.671125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf0695-c31d-4293-ab58-cd592393063f None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:26.671439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf0695-c31d-4293-ab58-cd592393063f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:26.672810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf0695-c31d-4293-ab58-cd592393063f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:26.686686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 111/220] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:26.686686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf0695-c31d-4293-ab58-cd592393063f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.700571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 110/221] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:26 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:26.701702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5e2f0-b648-4bf4-9aab-62afacb59461 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.842777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf0695-c31d-4293-ab58-cd592393063f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:26.844949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:26.849496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d5e2f0-b648-4bf4-9aab-62afacb59461 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:26.887017 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee693-59ba-425e-bb93-b5d46618964a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:26.889883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee693-59ba-425e-bb93-b5d46618964a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.889883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee693-59ba-425e-bb93-b5d46618964a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.889883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ee693-59ba-425e-bb93-b5d46618964a None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.889883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ee693-59ba-425e-bb93-b5d46618964a None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:26.891500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ee693-59ba-425e-bb93-b5d46618964a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:26.891935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320602ea-5eee-472b-880c-37a28ad15092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:26.893706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320602ea-5eee-472b-880c-37a28ad15092 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:26.893706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320602ea-5eee-472b-880c-37a28ad15092 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:26.893706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320602ea-5eee-472b-880c-37a28ad15092 None admin] PATH_INFO: `/v3/users/4ddc3fa5f97c40e39cea6dc8ff66d4ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:26.897320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 112/222] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:26 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:26.899836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee693-59ba-425e-bb93-b5d46618964a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.910793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320602ea-5eee-472b-880c-37a28ad15092 None admin] RBAC: Authorizing `identity:get_user(user_id=4ddc3fa5f97c40e39cea6dc8ff66d4ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:26.912307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320602ea-5eee-472b-880c-37a28ad15092 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:26.914256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 111/223] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:26 2022] GET /identity/v3/users/4ddc3fa5f97c40e39cea6dc8ff66d4ae => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:26.920233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320602ea-5eee-472b-880c-37a28ad15092 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:26.930747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:27.050528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ee693-59ba-425e-bb93-b5d46618964a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:27.083756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320602ea-5eee-472b-880c-37a28ad15092 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:27.092235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bf19e-488f-4d9d-b725-29202bfd2f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:27.092907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bf19e-488f-4d9d-b725-29202bfd2f7d None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:27.093188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bf19e-488f-4d9d-b725-29202bfd2f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:27.093463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bf19e-488f-4d9d-b725-29202bfd2f7d None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6/users/2fa4a4adf10c4a628567a904e967b359/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:27.095434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bf19e-488f-4d9d-b725-29202bfd2f7d None admin] RBAC: Authorizing `identity:create_grant(project_id=b2306424887947e5938736c5bbfeabb6, user_id=2fa4a4adf10c4a628567a904e967b359, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:27.096912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bf19e-488f-4d9d-b725-29202bfd2f7d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:27.114196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 113/224] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:26:26 2022] PUT /identity/v3/projects/b2306424887947e5938736c5bbfeabb6/users/2fa4a4adf10c4a628567a904e967b359/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:27.118091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132f204-e935-4491-9719-823c324b4380 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:27.118091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132f204-e935-4491-9719-823c324b4380 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:27.118091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132f204-e935-4491-9719-823c324b4380 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:27.118390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 114/225] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:27.124864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26523ae-d15d-4a1f-a233-7c1851c86c3c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:27.125373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26523ae-d15d-4a1f-a233-7c1851c86c3c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:27.125726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26523ae-d15d-4a1f-a233-7c1851c86c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:27.138154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42f894-d46f-4207-b422-fb8515713127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:27.139073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42f894-d46f-4207-b422-fb8515713127 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:27.139489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42f894-d46f-4207-b422-fb8515713127 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:27.139904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42f894-d46f-4207-b422-fb8515713127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:27.146967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d26523ae-d15d-4a1f-a233-7c1851c86c3c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:27.149463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d26523ae-d15d-4a1f-a233-7c1851c86c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:27.180770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:27.238131 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 115/226] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:27.264538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26523ae-d15d-4a1f-a233-7c1851c86c3c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:27.292631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42f894-d46f-4207-b422-fb8515713127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:27.294499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42f894-d46f-4207-b422-fb8515713127 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:27.309183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:27.390051 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26523ae-d15d-4a1f-a233-7c1851c86c3c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:27.453252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 112/227] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:27.454107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6cbe3-ca4d-4905-bb2c-ef77ebbb0aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:27.454841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6cbe3-ca4d-4905-bb2c-ef77ebbb0aab None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:27.455198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6cbe3-ca4d-4905-bb2c-ef77ebbb0aab None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:27.455742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6cbe3-ca4d-4905-bb2c-ef77ebbb0aab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:27.459202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42f894-d46f-4207-b422-fb8515713127 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:27.478104 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6cbe3-ca4d-4905-bb2c-ef77ebbb0aab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-cba6cbe3-ca4d-4905-bb2c-ef77ebbb0aab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:27.483687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:27.484545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:27.485339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:27.488630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 116/228] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:27.491647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6cbe3-ca4d-4905-bb2c-ef77ebbb0aab None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:27.530209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:27.567847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42f894-d46f-4207-b422-fb8515713127 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:27.575534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:27.604363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b327f9-8d18-4023-ba4e-770e3832a362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:27.605007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b327f9-8d18-4023-ba4e-770e3832a362 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:27.605284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b327f9-8d18-4023-ba4e-770e3832a362 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:27.605550 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b327f9-8d18-4023-ba4e-770e3832a362 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:27.606711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b327f9-8d18-4023-ba4e-770e3832a362 None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:27.608235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b327f9-8d18-4023-ba4e-770e3832a362 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:27.610288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 113/229] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:27 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:27.619692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b327f9-8d18-4023-ba4e-770e3832a362 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:27.645508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6cbe3-ca4d-4905-bb2c-ef77ebbb0aab None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:27.711389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4d06a-17a0-4b0d-93d3-9224096f7e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:27.712180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4d06a-17a0-4b0d-93d3-9224096f7e31 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:27.712465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4d06a-17a0-4b0d-93d3-9224096f7e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:27.712737 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4d06a-17a0-4b0d-93d3-9224096f7e31 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:27.713469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4d06a-17a0-4b0d-93d3-9224096f7e31 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:27.713771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4d06a-17a0-4b0d-93d3-9224096f7e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:27.715146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca4d06a-17a0-4b0d-93d3-9224096f7e31 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:27.736833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 117/230] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:27.741485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4d06a-17a0-4b0d-93d3-9224096f7e31 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:27.815829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b327f9-8d18-4023-ba4e-770e3832a362 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:27.874948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7737e-22b2-4d85-b4c1-0fc293f77b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:27.875573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7737e-22b2-4d85-b4c1-0fc293f77b51 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:27.875853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7737e-22b2-4d85-b4c1-0fc293f77b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:27.880659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7737e-22b2-4d85-b4c1-0fc293f77b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:27.881992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7737e-22b2-4d85-b4c1-0fc293f77b51 None admin] RBAC: Adding query filter params (role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=b2306424887947e5938736c5bbfeabb6, user.id=4ddc3fa5f97c40e39cea6dc8ff66d4ae) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:27.882310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7737e-22b2-4d85-b4c1-0fc293f77b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:27.883752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7737e-22b2-4d85-b4c1-0fc293f77b51 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:27.896347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 114/231] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:27 2022] GET /identity/v3/role_assignments?user.id=4ddc3fa5f97c40e39cea6dc8ff66d4ae&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:27.903261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:27.935201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca4d06a-17a0-4b0d-93d3-9224096f7e31 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:27.989140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a804c48-a24c-4137-bde1-34580f81b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:27.989796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a804c48-a24c-4137-bde1-34580f81b5cf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:27.990077 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a804c48-a24c-4137-bde1-34580f81b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:27.990352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a804c48-a24c-4137-bde1-34580f81b5cf None admin] PATH_INFO: `/v3/users/2fa4a4adf10c4a628567a904e967b359` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:27.991572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a804c48-a24c-4137-bde1-34580f81b5cf None admin] RBAC: Authorizing `identity:get_user(user_id=2fa4a4adf10c4a628567a904e967b359)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:27.993061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a804c48-a24c-4137-bde1-34580f81b5cf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:27.995023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 118/232] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:27 2022] GET /identity/v3/users/2fa4a4adf10c4a628567a904e967b359 => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:28.000368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7737e-22b2-4d85-b4c1-0fc293f77b51 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:28.062269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:28.151897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7737e-22b2-4d85-b4c1-0fc293f77b51 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:28.189740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ea84c-8d34-4f9c-b840-e30b52c3bbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:28.190396 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ea84c-8d34-4f9c-b840-e30b52c3bbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:28.190675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ea84c-8d34-4f9c-b840-e30b52c3bbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:28.190950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ea84c-8d34-4f9c-b840-e30b52c3bbb2 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:28.192116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ea84c-8d34-4f9c-b840-e30b52c3bbb2 None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:28.193577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ea84c-8d34-4f9c-b840-e30b52c3bbb2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:28.196076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 115/233] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:27 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:28.201898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a804c48-a24c-4137-bde1-34580f81b5cf None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:28.322775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a804c48-a24c-4137-bde1-34580f81b5cf None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:28.369716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3b1c0-9c4a-43c7-8274-eea902a389b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:28.370406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b1c0-9c4a-43c7-8274-eea902a389b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:28.370693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b1c0-9c4a-43c7-8274-eea902a389b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:28.370969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b1c0-9c4a-43c7-8274-eea902a389b6 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6/users/2fa4a4adf10c4a628567a904e967b359/roles/67ac8da7e16f46b496e98633276e6909` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:28.373214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3b1c0-9c4a-43c7-8274-eea902a389b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2306424887947e5938736c5bbfeabb6, user_id=2fa4a4adf10c4a628567a904e967b359, role_id=67ac8da7e16f46b496e98633276e6909)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:28.374676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3b1c0-9c4a-43c7-8274-eea902a389b6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:28.408629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 119/234] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:26:28 2022] PUT /identity/v3/projects/b2306424887947e5938736c5bbfeabb6/users/2fa4a4adf10c4a628567a904e967b359/roles/67ac8da7e16f46b496e98633276e6909 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:29.109877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114edbdd-3618-451d-8872-a44145949bf1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.110353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114edbdd-3618-451d-8872-a44145949bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.110353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114edbdd-3618-451d-8872-a44145949bf1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.111986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 116/235] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:29.117483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5953-d98e-425e-ae4e-1dfb3e756e98 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.117771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5953-d98e-425e-ae4e-1dfb3e756e98 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.118048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea5953-d98e-425e-ae4e-1dfb3e756e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.136240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9fea5953-d98e-425e-ae4e-1dfb3e756e98 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:29.137416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9fea5953-d98e-425e-ae4e-1dfb3e756e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:29.140178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:29.224262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 120/236] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:29.244834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114edbdd-3618-451d-8872-a44145949bf1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:29.261921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c02563-40a9-4109-bf5a-e9a1254ec1b8 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.262214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c02563-40a9-4109-bf5a-e9a1254ec1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.262466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c02563-40a9-4109-bf5a-e9a1254ec1b8 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.264293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 121/237] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:29.268949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9278591-9b3c-4fd6-8371-c32dd92a2751 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.269233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9278591-9b3c-4fd6-8371-c32dd92a2751 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.269513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9278591-9b3c-4fd6-8371-c32dd92a2751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.295295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c9278591-9b3c-4fd6-8371-c32dd92a2751 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:29.296503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c9278591-9b3c-4fd6-8371-c32dd92a2751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:29.407264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 122/238] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:29.432626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9278591-9b3c-4fd6-8371-c32dd92a2751 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:29.453750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114edbdd-3618-451d-8872-a44145949bf1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:29.467513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:29.521749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:29.543460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9278591-9b3c-4fd6-8371-c32dd92a2751 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:29.552840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aa174-7b6c-4e50-bbca-2c22da3ef642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:29.553548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aa174-7b6c-4e50-bbca-2c22da3ef642 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.553834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aa174-7b6c-4e50-bbca-2c22da3ef642 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.554144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aa174-7b6c-4e50-bbca-2c22da3ef642 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.571026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aa174-7b6c-4e50-bbca-2c22da3ef642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-425aa174-7b6c-4e50-bbca-2c22da3ef642 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:29.576082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:29.576958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:29.577725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:29.581076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1ba96-768f-49c9-848f-94933c25e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:29.581716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ba96-768f-49c9-848f-94933c25e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.581998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ba96-768f-49c9-848f-94933c25e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.582265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1ba96-768f-49c9-848f-94933c25e0d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.583394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1ba96-768f-49c9-848f-94933c25e0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:29.585415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1ba96-768f-49c9-848f-94933c25e0d4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:29.587194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 123/239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:29.589555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 117/240] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:29.592247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1ba96-768f-49c9-848f-94933c25e0d4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:29.595356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aa174-7b6c-4e50-bbca-2c22da3ef642 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:29.695621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1ba96-768f-49c9-848f-94933c25e0d4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:29.731163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d006133-719a-40c4-9380-36d0fd65b96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:29.731780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006133-719a-40c4-9380-36d0fd65b96c None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.732057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006133-719a-40c4-9380-36d0fd65b96c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.732357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d006133-719a-40c4-9380-36d0fd65b96c None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.733192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006133-719a-40c4-9380-36d0fd65b96c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:29.734754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d006133-719a-40c4-9380-36d0fd65b96c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:29.748473 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:29.768507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 124/241] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:29 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:29.770320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d10b0-e6ee-421a-a476-a8e6b64ec681 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.770853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d10b0-e6ee-421a-a476-a8e6b64ec681 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.771319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d10b0-e6ee-421a-a476-a8e6b64ec681 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.773828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 125/242] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:29.780225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b1707-07ff-40a2-a0e3-a255ad7a8a3a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.781024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b1707-07ff-40a2-a0e3-a255ad7a8a3a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.781623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b1707-07ff-40a2-a0e3-a255ad7a8a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.827793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-037b1707-07ff-40a2-a0e3-a255ad7a8a3a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:29.830402 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-037b1707-07ff-40a2-a0e3-a255ad7a8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:29.869494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aa174-7b6c-4e50-bbca-2c22da3ef642 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:29.915568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438da24-a2fb-4074-9f2d-8fb90f76f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:29.916246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438da24-a2fb-4074-9f2d-8fb90f76f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:29.916526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438da24-a2fb-4074-9f2d-8fb90f76f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:29.916794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438da24-a2fb-4074-9f2d-8fb90f76f5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:29.917644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438da24-a2fb-4074-9f2d-8fb90f76f5d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:29.917950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438da24-a2fb-4074-9f2d-8fb90f76f5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:29.919561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438da24-a2fb-4074-9f2d-8fb90f76f5d7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:29.940161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 118/243] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:29.946344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438da24-a2fb-4074-9f2d-8fb90f76f5d7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:29.956231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 126/244] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:29.978675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b1707-07ff-40a2-a0e3-a255ad7a8a3a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:29.983523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:30.067432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438da24-a2fb-4074-9f2d-8fb90f76f5d7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:30.092631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b1707-07ff-40a2-a0e3-a255ad7a8a3a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:30.110464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe855a-7baa-4764-9051-7beb0694ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:30.111122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe855a-7baa-4764-9051-7beb0694ef38 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:30.111391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe855a-7baa-4764-9051-7beb0694ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:30.111663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe855a-7baa-4764-9051-7beb0694ef38 None admin] PATH_INFO: `/v3/users/38aa28e1aedf4721be5f8efe8df0fd8f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:30.122273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:30.128380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe855a-7baa-4764-9051-7beb0694ef38 None admin] RBAC: Authorizing `identity:get_user(user_id=38aa28e1aedf4721be5f8efe8df0fd8f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:30.130281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fe855a-7baa-4764-9051-7beb0694ef38 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:30.134768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 119/245] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:29 2022] GET /identity/v3/users/38aa28e1aedf4721be5f8efe8df0fd8f => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:30.136842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63d683-b8ea-4b0d-b3eb-71bfe2b2b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:30.138688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63d683-b8ea-4b0d-b3eb-71bfe2b2b2ab None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:30.139098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63d683-b8ea-4b0d-b3eb-71bfe2b2b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:30.140091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe855a-7baa-4764-9051-7beb0694ef38 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:30.140911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63d683-b8ea-4b0d-b3eb-71bfe2b2b2ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:30.158434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63d683-b8ea-4b0d-b3eb-71bfe2b2b2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-2b63d683-b8ea-4b0d-b3eb-71bfe2b2b2ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:30.165139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:30.166016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:30.166837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 127/246] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:30.173736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63d683-b8ea-4b0d-b3eb-71bfe2b2b2ab None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:30.239983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:30.256855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe855a-7baa-4764-9051-7beb0694ef38 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:30.290917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63d683-b8ea-4b0d-b3eb-71bfe2b2b2ab None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:30.295800 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2641dc-3fed-4ce2-aa2c-e758185622b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:30.296699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2641dc-3fed-4ce2-aa2c-e758185622b3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:30.297178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2641dc-3fed-4ce2-aa2c-e758185622b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:30.297646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2641dc-3fed-4ce2-aa2c-e758185622b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:30.337616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9b899-044d-43df-ab5c-232451d2d8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:30.339739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9b899-044d-43df-ab5c-232451d2d8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:30.341153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9b899-044d-43df-ab5c-232451d2d8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:30.341455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9b899-044d-43df-ab5c-232451d2d8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:30.342323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9b899-044d-43df-ab5c-232451d2d8f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:30.342632 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9b899-044d-43df-ab5c-232451d2d8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:30.344038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9b899-044d-43df-ab5c-232451d2d8f3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:30.355469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 128/247] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:30.360554 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9b899-044d-43df-ab5c-232451d2d8f3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:30.377313 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2641dc-3fed-4ce2-aa2c-e758185622b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:30.379071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2641dc-3fed-4ce2-aa2c-e758185622b3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:30.416699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:30.492428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9b899-044d-43df-ab5c-232451d2d8f3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:30.494805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:30.516651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 120/248] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:30.518337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d1e96-3171-4575-bb20-0aeb9d742052 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:30.518820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d1e96-3171-4575-bb20-0aeb9d742052 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:30.519229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d1e96-3171-4575-bb20-0aeb9d742052 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:30.520961 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 121/249] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:30.522655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d1e96-3171-4575-bb20-0aeb9d742052 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:30.546106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5ac8d-f5af-4936-9230-52a042a9c810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:30.546757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5ac8d-f5af-4936-9230-52a042a9c810 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:30.547036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5ac8d-f5af-4936-9230-52a042a9c810 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:30.547310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5ac8d-f5af-4936-9230-52a042a9c810 None admin] PATH_INFO: `/v3/users/2fa4a4adf10c4a628567a904e967b359` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:30.548686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5ac8d-f5af-4936-9230-52a042a9c810 None admin] RBAC: Authorizing `identity:get_user(user_id=2fa4a4adf10c4a628567a904e967b359)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:30.550337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d5ac8d-f5af-4936-9230-52a042a9c810 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:30.552076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 129/250] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:30 2022] GET /identity/v3/users/2fa4a4adf10c4a628567a904e967b359 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:30.553371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a953-16a8-43f7-af81-2d60154b1704 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:30.553821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a953-16a8-43f7-af81-2d60154b1704 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:30.554101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a953-16a8-43f7-af81-2d60154b1704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:30.574647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1e89a953-16a8-43f7-af81-2d60154b1704 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:30.577355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1e89a953-16a8-43f7-af81-2d60154b1704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:30.686734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 130/251] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:30.687613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89a953-16a8-43f7-af81-2d60154b1704 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:30.735174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d1e96-3171-4575-bb20-0aeb9d742052 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:30.741412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:30.818424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89a953-16a8-43f7-af81-2d60154b1704 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:30.833726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0006fbc-6e4b-42d8-bd9a-ce083d3595e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:30.834911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0006fbc-6e4b-42d8-bd9a-ce083d3595e4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:30.835199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0006fbc-6e4b-42d8-bd9a-ce083d3595e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:30.835745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0006fbc-6e4b-42d8-bd9a-ce083d3595e4 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:30.837219 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0006fbc-6e4b-42d8-bd9a-ce083d3595e4 None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:30.839435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0006fbc-6e4b-42d8-bd9a-ce083d3595e4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:30.845124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 122/252] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:30 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:30.846600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0006fbc-6e4b-42d8-bd9a-ce083d3595e4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:30.874136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcb3f9-96e5-46b7-a5bb-066e0b80dec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:30.874810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcb3f9-96e5-46b7-a5bb-066e0b80dec4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:30.875085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcb3f9-96e5-46b7-a5bb-066e0b80dec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:30.876283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcb3f9-96e5-46b7-a5bb-066e0b80dec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:30.955385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:30.972592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcb3f9-96e5-46b7-a5bb-066e0b80dec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:30.974280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bcb3f9-96e5-46b7-a5bb-066e0b80dec4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:31.020531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:31.078140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0006fbc-6e4b-42d8-bd9a-ce083d3595e4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:31.091962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 131/253] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:31.092164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcb3f9-96e5-46b7-a5bb-066e0b80dec4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:31.153132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d4c39-6966-41bb-9027-db65e90c92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:31.155227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d4c39-6966-41bb-9027-db65e90c92da None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:31.155762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d4c39-6966-41bb-9027-db65e90c92da None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:31.156034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d4c39-6966-41bb-9027-db65e90c92da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:31.184191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d4c39-6966-41bb-9027-db65e90c92da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-fb3d4c39-6966-41bb-9027-db65e90c92da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:31.191570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:31.192468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:31.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:31.194363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 123/254] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:31.196934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d4c39-6966-41bb-9027-db65e90c92da None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:31.244744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcb3f9-96e5-46b7-a5bb-066e0b80dec4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:31.290994 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc2bcee-e82a-487d-8d82-c08c3d3e06e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:31.292886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2bcee-e82a-487d-8d82-c08c3d3e06e2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:31.293365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2bcee-e82a-487d-8d82-c08c3d3e06e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:31.294321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc2bcee-e82a-487d-8d82-c08c3d3e06e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:31.295800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2bcee-e82a-487d-8d82-c08c3d3e06e2 None admin] RBAC: Adding query filter params (role.id=e7456e6d5b404412ad235b2bfeb1df9b, scope.project.id=b2306424887947e5938736c5bbfeabb6, user.id=38aa28e1aedf4721be5f8efe8df0fd8f) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:31.296352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2bcee-e82a-487d-8d82-c08c3d3e06e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:31.298502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc2bcee-e82a-487d-8d82-c08c3d3e06e2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:31.307438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 132/255] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:31 2022] GET /identity/v3/role_assignments?user.id=38aa28e1aedf4721be5f8efe8df0fd8f&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=e7456e6d5b404412ad235b2bfeb1df9b => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:31.309296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fef79-0127-451a-b592-b2f8a4de2b97 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:31.310184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fef79-0127-451a-b592-b2f8a4de2b97 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:31.310640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fef79-0127-451a-b592-b2f8a4de2b97 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:31.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 133/256] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:31.317270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fef79-0127-451a-b592-b2f8a4de2b97 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:31.325569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d4c39-6966-41bb-9027-db65e90c92da None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:31.335038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:31.342169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:31.364917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba24fb-1456-4acf-b541-d3834df70b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:31.365561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba24fb-1456-4acf-b541-d3834df70b9e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:31.366429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba24fb-1456-4acf-b541-d3834df70b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:31.366703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba24fb-1456-4acf-b541-d3834df70b9e None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:31.368049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba24fb-1456-4acf-b541-d3834df70b9e None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:31.369655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba24fb-1456-4acf-b541-d3834df70b9e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:31.371623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 124/257] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:31 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:31.373504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16322df-482c-4444-8b88-c87fb0f97d6c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:31.373794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16322df-482c-4444-8b88-c87fb0f97d6c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:31.374075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16322df-482c-4444-8b88-c87fb0f97d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:31.396585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c16322df-482c-4444-8b88-c87fb0f97d6c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:31.397917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c16322df-482c-4444-8b88-c87fb0f97d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:31.461084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fef79-0127-451a-b592-b2f8a4de2b97 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:31.471795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 125/258] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:31.473069 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16322df-482c-4444-8b88-c87fb0f97d6c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:31.502371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ee047-6fdb-4cae-a05e-e4f3be2f376a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:31.503420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ee047-6fdb-4cae-a05e-e4f3be2f376a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:31.503912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ee047-6fdb-4cae-a05e-e4f3be2f376a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:31.504401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ee047-6fdb-4cae-a05e-e4f3be2f376a None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:31.505412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ee047-6fdb-4cae-a05e-e4f3be2f376a None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:31.506224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ee047-6fdb-4cae-a05e-e4f3be2f376a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:31.508955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ee047-6fdb-4cae-a05e-e4f3be2f376a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:31.520228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 134/259] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:31.524352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ee047-6fdb-4cae-a05e-e4f3be2f376a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:31.606531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16322df-482c-4444-8b88-c87fb0f97d6c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:31.636586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:31.638164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:31.658518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ee047-6fdb-4cae-a05e-e4f3be2f376a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:31.700161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc647ce9-35df-41e7-9e91-5d84f5df7f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:31.700816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc647ce9-35df-41e7-9e91-5d84f5df7f2e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:31.701082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc647ce9-35df-41e7-9e91-5d84f5df7f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:31.701356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc647ce9-35df-41e7-9e91-5d84f5df7f2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:31.702263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc647ce9-35df-41e7-9e91-5d84f5df7f2e None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=b2306424887947e5938736c5bbfeabb6, user.id=2fa4a4adf10c4a628567a904e967b359) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:31.702573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc647ce9-35df-41e7-9e91-5d84f5df7f2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:31.703017 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4aebf-7002-42e8-9320-e5a5dd4689af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:31.703857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4aebf-7002-42e8-9320-e5a5dd4689af None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:31.704024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc647ce9-35df-41e7-9e91-5d84f5df7f2e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:31.704576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4aebf-7002-42e8-9320-e5a5dd4689af None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:31.705055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b4aebf-7002-42e8-9320-e5a5dd4689af None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:31.720278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 126/260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:31 2022] GET /identity/v3/role_assignments?user.id=2fa4a4adf10c4a628567a904e967b359&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:31.723449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc647ce9-35df-41e7-9e91-5d84f5df7f2e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:31.739464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b4aebf-7002-42e8-9320-e5a5dd4689af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b5b4aebf-7002-42e8-9320-e5a5dd4689af None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:31.744894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:31.745800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:31.746556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:31.754773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 135/261] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:31.759516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4aebf-7002-42e8-9320-e5a5dd4689af None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:31.960359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b4aebf-7002-42e8-9320-e5a5dd4689af None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:31.988153 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc647ce9-35df-41e7-9e91-5d84f5df7f2e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:32.004527 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:32.017417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7cb75-38b1-4d7f-966d-a0b40016fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:32.018060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7cb75-38b1-4d7f-966d-a0b40016fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.018340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7cb75-38b1-4d7f-966d-a0b40016fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.018612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7cb75-38b1-4d7f-966d-a0b40016fcd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.019347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7cb75-38b1-4d7f-966d-a0b40016fcd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:32.019651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7cb75-38b1-4d7f-966d-a0b40016fcd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:32.021250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7cb75-38b1-4d7f-966d-a0b40016fcd5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:32.038668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 136/262] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:32.045140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7cb75-38b1-4d7f-966d-a0b40016fcd5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:32.088847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39517a-98dc-4d9d-93d2-1ccfcbe46253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:32.089509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39517a-98dc-4d9d-93d2-1ccfcbe46253 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.089788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39517a-98dc-4d9d-93d2-1ccfcbe46253 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.090062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39517a-98dc-4d9d-93d2-1ccfcbe46253 None admin] PATH_INFO: `/v3/users/4ddc3fa5f97c40e39cea6dc8ff66d4ae` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.091438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39517a-98dc-4d9d-93d2-1ccfcbe46253 None admin] RBAC: Authorizing `identity:get_user(user_id=4ddc3fa5f97c40e39cea6dc8ff66d4ae)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:32.092901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39517a-98dc-4d9d-93d2-1ccfcbe46253 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:32.094714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 127/263] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:31 2022] GET /identity/v3/users/4ddc3fa5f97c40e39cea6dc8ff66d4ae => generated 297 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:32.105082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39517a-98dc-4d9d-93d2-1ccfcbe46253 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:32.152313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7cb75-38b1-4d7f-966d-a0b40016fcd5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:32.175119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:32.195278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd622991-d308-419e-b456-8a9d69b2dcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:32.195938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd622991-d308-419e-b456-8a9d69b2dcba None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.197112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd622991-d308-419e-b456-8a9d69b2dcba None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.197394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd622991-d308-419e-b456-8a9d69b2dcba None admin] PATH_INFO: `/v3/users/2fa4a4adf10c4a628567a904e967b359` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.199453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd622991-d308-419e-b456-8a9d69b2dcba None admin] RBAC: Authorizing `identity:get_user(user_id=2fa4a4adf10c4a628567a904e967b359)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:32.202083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd622991-d308-419e-b456-8a9d69b2dcba None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:32.205384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 137/264] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:32 2022] GET /identity/v3/users/2fa4a4adf10c4a628567a904e967b359 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:32.213387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd622991-d308-419e-b456-8a9d69b2dcba None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:32.293921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39517a-98dc-4d9d-93d2-1ccfcbe46253 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:32.344242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:32.359970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78c772-0bdd-4fe1-81d6-354182cb276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:32.360653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78c772-0bdd-4fe1-81d6-354182cb276c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.360934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78c772-0bdd-4fe1-81d6-354182cb276c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.361207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78c772-0bdd-4fe1-81d6-354182cb276c None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.363652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78c772-0bdd-4fe1-81d6-354182cb276c None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:32.365142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78c772-0bdd-4fe1-81d6-354182cb276c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:32.372313 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 128/265] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:32 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:32.380965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78c772-0bdd-4fe1-81d6-354182cb276c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:32.444352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd622991-d308-419e-b456-8a9d69b2dcba None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:32.500499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf133e-2b13-4bb2-867a-95035953c415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:32.501470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf133e-2b13-4bb2-867a-95035953c415 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.502056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf133e-2b13-4bb2-867a-95035953c415 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.505163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf133e-2b13-4bb2-867a-95035953c415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.599980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78c772-0bdd-4fe1-81d6-354182cb276c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:32.623388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:32.633348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf133e-2b13-4bb2-867a-95035953c415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:32.634861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf133e-2b13-4bb2-867a-95035953c415 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:32.667363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546a457-9708-4e90-815e-743a404cf9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:32.668049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546a457-9708-4e90-815e-743a404cf9c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.668359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546a457-9708-4e90-815e-743a404cf9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.668639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546a457-9708-4e90-815e-743a404cf9c3 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6/users/4ddc3fa5f97c40e39cea6dc8ff66d4ae/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.672935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546a457-9708-4e90-815e-743a404cf9c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2306424887947e5938736c5bbfeabb6, user_id=4ddc3fa5f97c40e39cea6dc8ff66d4ae, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:32.674389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546a457-9708-4e90-815e-743a404cf9c3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:32.700976 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 129/266] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:26:32 2022] PUT /identity/v3/projects/b2306424887947e5938736c5bbfeabb6/users/4ddc3fa5f97c40e39cea6dc8ff66d4ae/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:26:32.702868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb3be9-73a4-41c7-8f62-e2905a9a6cca None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.703200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb3be9-73a4-41c7-8f62-e2905a9a6cca None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.703873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb3be9-73a4-41c7-8f62-e2905a9a6cca None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.710778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 130/267] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:32.717412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737509-acd9-4a80-9c31-e1cb51935b8c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.717707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737509-acd9-4a80-9c31-e1cb51935b8c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.717964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36737509-acd9-4a80-9c31-e1cb51935b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.759362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-36737509-acd9-4a80-9c31-e1cb51935b8c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:32.760569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-36737509-acd9-4a80-9c31-e1cb51935b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:32.768633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:32.854189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 131/268] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:32.868431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24914-f26e-4396-978a-7c80848a1657 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.868880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24914-f26e-4396-978a-7c80848a1657 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.869160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee24914-f26e-4396-978a-7c80848a1657 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.870622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 132/269] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:32.872958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 138/270] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:32.879167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf133e-2b13-4bb2-867a-95035953c415 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:32.879385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623dfda-283a-4ef1-9c0e-b0c28375feee None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:32.879677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623dfda-283a-4ef1-9c0e-b0c28375feee None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:32.879945 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623dfda-283a-4ef1-9c0e-b0c28375feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:32.904616 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0623dfda-283a-4ef1-9c0e-b0c28375feee None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:32.906236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0623dfda-283a-4ef1-9c0e-b0c28375feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:32.982882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 133/271] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:32.983741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623dfda-283a-4ef1-9c0e-b0c28375feee None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:32.996904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf133e-2b13-4bb2-867a-95035953c415 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:33.037833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d8c7-56b7-4676-b74b-bfddcd318a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:33.038484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d8c7-56b7-4676-b74b-bfddcd318a4e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.039009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d8c7-56b7-4676-b74b-bfddcd318a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.039283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5d8c7-56b7-4676-b74b-bfddcd318a4e None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.041161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5d8c7-56b7-4676-b74b-bfddcd318a4e None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:33.043215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:33.044587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5d8c7-56b7-4676-b74b-bfddcd318a4e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:33.046343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 139/272] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:32 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:33.047310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d8c7-56b7-4676-b74b-bfddcd318a4e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:33.088810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:33.132855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623dfda-283a-4ef1-9c0e-b0c28375feee None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:33.170638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef0c2a-04e3-4d4d-bcae-28e6102ce6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:33.171772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef0c2a-04e3-4d4d-bcae-28e6102ce6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.172352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef0c2a-04e3-4d4d-bcae-28e6102ce6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.172826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef0c2a-04e3-4d4d-bcae-28e6102ce6b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.184604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef0c2a-04e3-4d4d-bcae-28e6102ce6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:33.185460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5d8c7-56b7-4676-b74b-bfddcd318a4e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-6bef0c2a-04e3-4d4d-bcae-28e6102ce6b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:33.190898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:33.191742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:33.192566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:33.200560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 134/273] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:33.201806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef0c2a-04e3-4d4d-bcae-28e6102ce6b3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:33.224268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f5d76-ddd3-4b73-aecc-d9368e8264bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:33.224940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f5d76-ddd3-4b73-aecc-d9368e8264bb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.225224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f5d76-ddd3-4b73-aecc-d9368e8264bb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.225496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f5d76-ddd3-4b73-aecc-d9368e8264bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.226652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f5d76-ddd3-4b73-aecc-d9368e8264bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:33.228455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f5d76-ddd3-4b73-aecc-d9368e8264bb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:33.231153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 140/274] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:33.232178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f5d76-ddd3-4b73-aecc-d9368e8264bb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:33.319181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:33.327683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef0c2a-04e3-4d4d-bcae-28e6102ce6b3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:33.338938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:33.344364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f5d76-ddd3-4b73-aecc-d9368e8264bb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:33.372030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5e21-3e77-4907-9861-4417e41f0305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:33.373159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e21-3e77-4907-9861-4417e41f0305 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.373871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e21-3e77-4907-9861-4417e41f0305 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.374532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e5e21-3e77-4907-9861-4417e41f0305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.375460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e21-3e77-4907-9861-4417e41f0305 None admin] RBAC: Adding query filter params (role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=b2306424887947e5938736c5bbfeabb6, user.id=2fa4a4adf10c4a628567a904e967b359) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:33.376171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e21-3e77-4907-9861-4417e41f0305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:33.378350 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e5e21-3e77-4907-9861-4417e41f0305 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:33.384998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d1388-6b66-483d-a46f-653c3f7cb773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:33.385779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d1388-6b66-483d-a46f-653c3f7cb773 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.386060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 135/275] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:33 2022] GET /identity/v3/role_assignments?user.id=2fa4a4adf10c4a628567a904e967b359&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=67ac8da7e16f46b496e98633276e6909 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:33.386252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d1388-6b66-483d-a46f-653c3f7cb773 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.386618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d1388-6b66-483d-a46f-653c3f7cb773 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.387256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5e21-3e77-4907-9861-4417e41f0305 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:33.387577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d1388-6b66-483d-a46f-653c3f7cb773 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:33.387972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d1388-6b66-483d-a46f-653c3f7cb773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:33.389522 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7d1388-6b66-483d-a46f-653c3f7cb773 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:33.400208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 141/276] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:33.405829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d1388-6b66-483d-a46f-653c3f7cb773 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:33.526548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e5e21-3e77-4907-9861-4417e41f0305 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:33.566234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fda61-1c5b-4a89-b657-9b1381f3c431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:33.567158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fda61-1c5b-4a89-b657-9b1381f3c431 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.573330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fda61-1c5b-4a89-b657-9b1381f3c431 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.573809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fda61-1c5b-4a89-b657-9b1381f3c431 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.574686 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fda61-1c5b-4a89-b657-9b1381f3c431 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:33.576326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fda61-1c5b-4a89-b657-9b1381f3c431 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:33.612811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 136/277] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:33 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:33.626699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7d1388-6b66-483d-a46f-653c3f7cb773 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:33.676263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8147e-7fcb-4abe-8334-03287689b662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:33.677382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8147e-7fcb-4abe-8334-03287689b662 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.677875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8147e-7fcb-4abe-8334-03287689b662 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.678867 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8147e-7fcb-4abe-8334-03287689b662 None admin] PATH_INFO: `/v3/users/c87048a0ae4c42d28f94787f1e29cc34` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.696513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8147e-7fcb-4abe-8334-03287689b662 None admin] RBAC: Authorizing `identity:get_user(user_id=c87048a0ae4c42d28f94787f1e29cc34)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:33.698384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf8147e-7fcb-4abe-8334-03287689b662 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:33.700864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 142/278] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:33 2022] GET /identity/v3/users/c87048a0ae4c42d28f94787f1e29cc34 => generated 293 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:33.706412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fda61-1c5b-4a89-b657-9b1381f3c431 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:33.728769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:33.854307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a2ef-3e61-4602-aa44-f9d418aa0a7a None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.854655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a2ef-3e61-4602-aa44-f9d418aa0a7a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.854848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fda61-1c5b-4a89-b657-9b1381f3c431 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:33.855117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134a2ef-3e61-4602-aa44-f9d418aa0a7a None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.860163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 143/279] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:33.861949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f53b4-262c-45b8-b03f-616576d4abdc None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.862449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f53b4-262c-45b8-b03f-616576d4abdc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.862960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f53b4-262c-45b8-b03f-616576d4abdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.883528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-576f53b4-262c-45b8-b03f-616576d4abdc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:33.884760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-576f53b4-262c-45b8-b03f-616576d4abdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:33.896690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:33.896875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a59f5-b8f5-4294-b4e4-a5f30693f236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:33.897490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a59f5-b8f5-4294-b4e4-a5f30693f236 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:33.897780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a59f5-b8f5-4294-b4e4-a5f30693f236 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:33.898050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a59f5-b8f5-4294-b4e4-a5f30693f236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:33.898958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a59f5-b8f5-4294-b4e4-a5f30693f236 None admin] RBAC: Adding query filter params (role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, user.id=c87048a0ae4c42d28f94787f1e29cc34, scope.system=all) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:33.899182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a59f5-b8f5-4294-b4e4-a5f30693f236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:33.900789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a59f5-b8f5-4294-b4e4-a5f30693f236 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:33.907540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 137/280] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 2 21:26:33 2022] GET /identity/v3/role_assignments?user.id=c87048a0ae4c42d28f94787f1e29cc34&scope.system=all&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:33.971428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 144/281] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:33.994931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a59f5-b8f5-4294-b4e4-a5f30693f236 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:34.085357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:34.109589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a59f5-b8f5-4294-b4e4-a5f30693f236 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:34.144870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eab1ea-96a6-4acf-8d63-1c243ac24520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:34.145512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eab1ea-96a6-4acf-8d63-1c243ac24520 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:34.145791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eab1ea-96a6-4acf-8d63-1c243ac24520 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:34.146063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eab1ea-96a6-4acf-8d63-1c243ac24520 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:34.157451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eab1ea-96a6-4acf-8d63-1c243ac24520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-63eab1ea-96a6-4acf-8d63-1c243ac24520 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:34.163465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:34.164354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:34.165134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 138/282] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:34.171054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f53b4-262c-45b8-b03f-616576d4abdc None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:34.278662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f53b4-262c-45b8-b03f-616576d4abdc None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:34.313553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88bad-e91f-4e5b-ac30-69d4a1dbacd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:34.314171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88bad-e91f-4e5b-ac30-69d4a1dbacd3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:34.314446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88bad-e91f-4e5b-ac30-69d4a1dbacd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:34.314715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef88bad-e91f-4e5b-ac30-69d4a1dbacd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:34.315431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef88bad-e91f-4e5b-ac30-69d4a1dbacd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:34.315734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef88bad-e91f-4e5b-ac30-69d4a1dbacd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:34.317129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef88bad-e91f-4e5b-ac30-69d4a1dbacd3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:34.325879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 145/283] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:34.331594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eab1ea-96a6-4acf-8d63-1c243ac24520 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:34.444553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eab1ea-96a6-4acf-8d63-1c243ac24520 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:34.481191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351b3b9-ad11-498f-ac90-ce778f186fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:34.481867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351b3b9-ad11-498f-ac90-ce778f186fea None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:34.482151 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351b3b9-ad11-498f-ac90-ce778f186fea None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:34.482429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351b3b9-ad11-498f-ac90-ce778f186fea None admin] PATH_INFO: `/v3/users/38aa28e1aedf4721be5f8efe8df0fd8f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:34.483592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351b3b9-ad11-498f-ac90-ce778f186fea None admin] RBAC: Authorizing `identity:get_user(user_id=38aa28e1aedf4721be5f8efe8df0fd8f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:34.485056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351b3b9-ad11-498f-ac90-ce778f186fea None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:34.486946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 139/284] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:34 2022] GET /identity/v3/users/38aa28e1aedf4721be5f8efe8df0fd8f => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:34.492568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88bad-e91f-4e5b-ac30-69d4a1dbacd3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:34.504146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:34.599127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef88bad-e91f-4e5b-ac30-69d4a1dbacd3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:34.634802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1e04f-2ed1-4a3d-909d-cf99b5ae51d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:34.635457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1e04f-2ed1-4a3d-909d-cf99b5ae51d5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:34.635740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1e04f-2ed1-4a3d-909d-cf99b5ae51d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:34.636014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1e04f-2ed1-4a3d-909d-cf99b5ae51d5 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:34.637231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1e04f-2ed1-4a3d-909d-cf99b5ae51d5 None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:34.638814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1e04f-2ed1-4a3d-909d-cf99b5ae51d5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:34.640694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 146/285] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:34 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:34.646286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351b3b9-ad11-498f-ac90-ce778f186fea None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:34.650701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:34.764928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351b3b9-ad11-498f-ac90-ce778f186fea None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:34.826847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88c70f-76d7-4cff-ac41-2a9a2f4dbc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:34.826847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88c70f-76d7-4cff-ac41-2a9a2f4dbc79 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:34.826847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88c70f-76d7-4cff-ac41-2a9a2f4dbc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:34.826847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88c70f-76d7-4cff-ac41-2a9a2f4dbc79 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6/users/38aa28e1aedf4721be5f8efe8df0fd8f/roles/e7456e6d5b404412ad235b2bfeb1df9b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:34.829167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88c70f-76d7-4cff-ac41-2a9a2f4dbc79 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2306424887947e5938736c5bbfeabb6, user_id=38aa28e1aedf4721be5f8efe8df0fd8f, role_id=e7456e6d5b404412ad235b2bfeb1df9b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:34.831498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88c70f-76d7-4cff-ac41-2a9a2f4dbc79 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:34.865876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 140/286] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:26:34 2022] PUT /identity/v3/projects/b2306424887947e5938736c5bbfeabb6/users/38aa28e1aedf4721be5f8efe8df0fd8f/roles/e7456e6d5b404412ad235b2bfeb1df9b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:35.063053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38184cb-2e2b-473a-a2b0-8c676e9821c2 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:35.063438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38184cb-2e2b-473a-a2b0-8c676e9821c2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:35.063617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38184cb-2e2b-473a-a2b0-8c676e9821c2 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:35.065318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 147/287] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:35.071475 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238e0b6-dddc-424c-9104-60b5f45e45e3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:35.071746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238e0b6-dddc-424c-9104-60b5f45e45e3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:35.072034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238e0b6-dddc-424c-9104-60b5f45e45e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:35.092443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1238e0b6-dddc-424c-9104-60b5f45e45e3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:35.093645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1238e0b6-dddc-424c-9104-60b5f45e45e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:35.162836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:35.172194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 141/288] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:35.208803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38184cb-2e2b-473a-a2b0-8c676e9821c2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:35.309495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:35.336057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38184cb-2e2b-473a-a2b0-8c676e9821c2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:35.370916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d9000-baa7-4780-854e-13eb9ee29d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:35.371558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d9000-baa7-4780-854e-13eb9ee29d8a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:35.371843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d9000-baa7-4780-854e-13eb9ee29d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:35.372119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d9000-baa7-4780-854e-13eb9ee29d8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:35.382426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d9000-baa7-4780-854e-13eb9ee29d8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-546d9000-baa7-4780-854e-13eb9ee29d8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:35.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:35.388712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:35.389465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 148/289] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:35.396772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238e0b6-dddc-424c-9104-60b5f45e45e3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:35.554795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238e0b6-dddc-424c-9104-60b5f45e45e3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:35.600423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e6ac-771c-4820-9658-b0c95b1fffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:35.601001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e6ac-771c-4820-9658-b0c95b1fffd4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:35.601283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e6ac-771c-4820-9658-b0c95b1fffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:35.601557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb2e6ac-771c-4820-9658-b0c95b1fffd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:35.602288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2e6ac-771c-4820-9658-b0c95b1fffd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:35.602596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2e6ac-771c-4820-9658-b0c95b1fffd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:35.603994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb2e6ac-771c-4820-9658-b0c95b1fffd4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:35.618098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 142/290] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:35.623969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d9000-baa7-4780-854e-13eb9ee29d8a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:35.741236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d9000-baa7-4780-854e-13eb9ee29d8a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:35.775206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886ac0e-867c-457e-9397-f97faec110c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:35.775847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886ac0e-867c-457e-9397-f97faec110c7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:35.776143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886ac0e-867c-457e-9397-f97faec110c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:35.776431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886ac0e-867c-457e-9397-f97faec110c7 None admin] PATH_INFO: `/v3/users/4ddc3fa5f97c40e39cea6dc8ff66d4ae` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:35.777615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886ac0e-867c-457e-9397-f97faec110c7 None admin] RBAC: Authorizing `identity:get_user(user_id=4ddc3fa5f97c40e39cea6dc8ff66d4ae)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:35.779084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886ac0e-867c-457e-9397-f97faec110c7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:35.781023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 149/291] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:35 2022] GET /identity/v3/users/4ddc3fa5f97c40e39cea6dc8ff66d4ae => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:35.786555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e6ac-771c-4820-9658-b0c95b1fffd4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:35.861034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:35.921410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb2e6ac-771c-4820-9658-b0c95b1fffd4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:35.963526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4971ecf-679f-4885-b0a0-022428102a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:35.964164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4971ecf-679f-4885-b0a0-022428102a15 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:35.964448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4971ecf-679f-4885-b0a0-022428102a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:35.964723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4971ecf-679f-4885-b0a0-022428102a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.053052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4971ecf-679f-4885-b0a0-022428102a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:36.054504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4971ecf-679f-4885-b0a0-022428102a15 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:36.125383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:36.167392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 143/292] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:36.173228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886ac0e-867c-457e-9397-f97faec110c7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:36.177151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:36.288398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886ac0e-867c-457e-9397-f97faec110c7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:36.326811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afd086-937c-4fc7-8834-31d4efbe080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:36.327456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afd086-937c-4fc7-8834-31d4efbe080a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:36.327738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afd086-937c-4fc7-8834-31d4efbe080a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:36.328012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afd086-937c-4fc7-8834-31d4efbe080a None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.331581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afd086-937c-4fc7-8834-31d4efbe080a None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:36.333078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afd086-937c-4fc7-8834-31d4efbe080a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:36.335535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 150/293] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:36 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:36.341201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4971ecf-679f-4885-b0a0-022428102a15 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:36.395856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e08cb-01c8-438c-9fac-cd9c1e094cc5 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:36.395856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e08cb-01c8-438c-9fac-cd9c1e094cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:36.396365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e08cb-01c8-438c-9fac-cd9c1e094cc5 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.400154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 151/294] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:36.408159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80c61a-0142-4849-b7b4-14a29afb4754 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:36.408159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80c61a-0142-4849-b7b4-14a29afb4754 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:36.408159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80c61a-0142-4849-b7b4-14a29afb4754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.447295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8b80c61a-0142-4849-b7b4-14a29afb4754 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:36.448527 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8b80c61a-0142-4849-b7b4-14a29afb4754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:36.465214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4971ecf-679f-4885-b0a0-022428102a15 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:36.503070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7b5ba-4cfa-4430-b860-89fdca5c9ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:36.503694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7b5ba-4cfa-4430-b860-89fdca5c9ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:36.503978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7b5ba-4cfa-4430-b860-89fdca5c9ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:36.504281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7b5ba-4cfa-4430-b860-89fdca5c9ee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.507627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7b5ba-4cfa-4430-b860-89fdca5c9ee9 None admin] RBAC: Adding query filter params (role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=b2306424887947e5938736c5bbfeabb6, user.id=4ddc3fa5f97c40e39cea6dc8ff66d4ae) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:36.507943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7b5ba-4cfa-4430-b860-89fdca5c9ee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:36.509407 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7b5ba-4cfa-4430-b860-89fdca5c9ee9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:36.525761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 144/295] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:36 2022] GET /identity/v3/role_assignments?user.id=4ddc3fa5f97c40e39cea6dc8ff66d4ae&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:36.578345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 152/296] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:36.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7b5ba-4cfa-4430-b860-89fdca5c9ee9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:36.636123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4350e30-82ee-4eb2-9dde-8f7330298770 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:36.636652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4350e30-82ee-4eb2-9dde-8f7330298770 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:36.636754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4350e30-82ee-4eb2-9dde-8f7330298770 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.638041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 153/297] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:36.651193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272352b-5b0c-4258-8576-5a9cd464c2d4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:36.651464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272352b-5b0c-4258-8576-5a9cd464c2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:36.651657 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272352b-5b0c-4258-8576-5a9cd464c2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.652909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:36.662154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:36.697320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0272352b-5b0c-4258-8576-5a9cd464c2d4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:36.698518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0272352b-5b0c-4258-8576-5a9cd464c2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:36.749567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7b5ba-4cfa-4430-b860-89fdca5c9ee9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:36.781334 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 154/298] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:36.788700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169a239-b4d1-4fc4-a7ef-b14355bcbb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:36.789371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169a239-b4d1-4fc4-a7ef-b14355bcbb2c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:36.789679 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169a239-b4d1-4fc4-a7ef-b14355bcbb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:36.789956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6169a239-b4d1-4fc4-a7ef-b14355bcbb2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.803385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6169a239-b4d1-4fc4-a7ef-b14355bcbb2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-6169a239-b4d1-4fc4-a7ef-b14355bcbb2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:36.808987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:36.809874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:36.810627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:36.813313 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 145/299] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:36.820479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272352b-5b0c-4258-8576-5a9cd464c2d4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:36.823461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169a239-b4d1-4fc4-a7ef-b14355bcbb2c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:36.914222 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:36.935033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272352b-5b0c-4258-8576-5a9cd464c2d4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:36.942410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6169a239-b4d1-4fc4-a7ef-b14355bcbb2c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:36.965777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:36.971377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b79b60-95e0-41ab-8b5c-97e6e2c90451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:36.972064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b79b60-95e0-41ab-8b5c-97e6e2c90451 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:36.972460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b79b60-95e0-41ab-8b5c-97e6e2c90451 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:36.972836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b79b60-95e0-41ab-8b5c-97e6e2c90451 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.973702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b79b60-95e0-41ab-8b5c-97e6e2c90451 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:36.974086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b79b60-95e0-41ab-8b5c-97e6e2c90451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:36.976979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b79b60-95e0-41ab-8b5c-97e6e2c90451 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:36.980521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0ba73-2fd3-4a68-802c-a0651b07e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:36.981334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0ba73-2fd3-4a68-802c-a0651b07e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:36.981759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0ba73-2fd3-4a68-802c-a0651b07e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:36.982174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0ba73-2fd3-4a68-802c-a0651b07e1c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:36.992226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 155/300] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:36.993528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b79b60-95e0-41ab-8b5c-97e6e2c90451 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:36.999172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0ba73-2fd3-4a68-802c-a0651b07e1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-baf0ba73-2fd3-4a68-802c-a0651b07e1c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:37.005971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:37.006824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:37.007581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 146/301] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:37.015220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0ba73-2fd3-4a68-802c-a0651b07e1c2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:37.131261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b79b60-95e0-41ab-8b5c-97e6e2c90451 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:37.146600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0ba73-2fd3-4a68-802c-a0651b07e1c2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:37.165960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6947923-7a29-40d1-baec-eb69a3fec69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:37.166533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6947923-7a29-40d1-baec-eb69a3fec69d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.166814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6947923-7a29-40d1-baec-eb69a3fec69d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.167088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6947923-7a29-40d1-baec-eb69a3fec69d None admin] PATH_INFO: `/v3/users/c87048a0ae4c42d28f94787f1e29cc34` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.168285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6947923-7a29-40d1-baec-eb69a3fec69d None admin] RBAC: Authorizing `identity:get_user(user_id=c87048a0ae4c42d28f94787f1e29cc34)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:37.169729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6947923-7a29-40d1-baec-eb69a3fec69d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:37.171337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 156/302] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:36 2022] GET /identity/v3/users/c87048a0ae4c42d28f94787f1e29cc34 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:37.172559 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b685c4-ceb5-4e22-91bc-48f6b2533cef None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.172834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b685c4-ceb5-4e22-91bc-48f6b2533cef None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.173115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b685c4-ceb5-4e22-91bc-48f6b2533cef None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.174846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 157/303] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:37.175499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d64d4-7a44-417d-b7eb-bd2d82b95a20 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.175734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d64d4-7a44-417d-b7eb-bd2d82b95a20 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.176063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d64d4-7a44-417d-b7eb-bd2d82b95a20 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.177441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 158/304] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:37.178556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d64d4-7a44-417d-b7eb-bd2d82b95a20 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:37.185445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a882bb-060d-447c-b998-7479d85513de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:37.186067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a882bb-060d-447c-b998-7479d85513de None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.186341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a882bb-060d-447c-b998-7479d85513de None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.186608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a882bb-060d-447c-b998-7479d85513de None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.187717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a882bb-060d-447c-b998-7479d85513de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:37.188042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a882bb-060d-447c-b998-7479d85513de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:37.190074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a882bb-060d-447c-b998-7479d85513de None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:37.199403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 147/305] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:37.200597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2344b-d527-4e85-a325-f968e7cc8e94 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.200879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2344b-d527-4e85-a325-f968e7cc8e94 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.201156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2344b-d527-4e85-a325-f968e7cc8e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.207789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:37.219409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2ca2344b-d527-4e85-a325-f968e7cc8e94 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:37.220632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2ca2344b-d527-4e85-a325-f968e7cc8e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:37.241942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:37.281671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d64d4-7a44-417d-b7eb-bd2d82b95a20 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:37.286298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 148/306] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:37.288076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad02b41-fe14-4bdc-9877-d4ea5c0215ec None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.288388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad02b41-fe14-4bdc-9877-d4ea5c0215ec None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.288660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad02b41-fe14-4bdc-9877-d4ea5c0215ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.305365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1ad02b41-fe14-4bdc-9877-d4ea5c0215ec None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:37.306522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1ad02b41-fe14-4bdc-9877-d4ea5c0215ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:37.320495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20828283-8c5c-4a9e-a726-23b924b9bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:37.321229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20828283-8c5c-4a9e-a726-23b924b9bba4 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.321514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20828283-8c5c-4a9e-a726-23b924b9bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.321792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20828283-8c5c-4a9e-a726-23b924b9bba4 None admin] PATH_INFO: `/v3/system/users/c87048a0ae4c42d28f94787f1e29cc34/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.323235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20828283-8c5c-4a9e-a726-23b924b9bba4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c87048a0ae4c42d28f94787f1e29cc34, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:37.324674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20828283-8c5c-4a9e-a726-23b924b9bba4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:37.333145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 159/307] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Aug 2 21:26:37 2022] PUT /identity/v3/system/users/c87048a0ae4c42d28f94787f1e29cc34/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:37.333794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20828283-8c5c-4a9e-a726-23b924b9bba4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:37.392208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 149/308] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:37.392208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad02b41-fe14-4bdc-9877-d4ea5c0215ec None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:37.456940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20828283-8c5c-4a9e-a726-23b924b9bba4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:37.470344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:37.487847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:37.499303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb804e-e46c-4bb1-8f7a-7542a829e19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:37.500198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb804e-e46c-4bb1-8f7a-7542a829e19f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.500686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb804e-e46c-4bb1-8f7a-7542a829e19f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.500965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb804e-e46c-4bb1-8f7a-7542a829e19f None admin] PATH_INFO: `/v3/users/969d2815134c43949580fecd0d7e5382` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.516628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb804e-e46c-4bb1-8f7a-7542a829e19f None admin] RBAC: Authorizing `identity:get_user(user_id=969d2815134c43949580fecd0d7e5382)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:37.518133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb804e-e46c-4bb1-8f7a-7542a829e19f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:37.524371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 160/309] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:37 2022] GET /identity/v3/users/969d2815134c43949580fecd0d7e5382 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:37.524521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad02b41-fe14-4bdc-9877-d4ea5c0215ec None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:37.524603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb804e-e46c-4bb1-8f7a-7542a829e19f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:37.560630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707d96-cd4f-428e-b236-a4ccb8ce984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:37.561283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707d96-cd4f-428e-b236-a4ccb8ce984d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.561564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707d96-cd4f-428e-b236-a4ccb8ce984d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.561835 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30707d96-cd4f-428e-b236-a4ccb8ce984d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.562968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30707d96-cd4f-428e-b236-a4ccb8ce984d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:37.564440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30707d96-cd4f-428e-b236-a4ccb8ce984d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:37.566033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 150/310] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:37.566794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707d96-cd4f-428e-b236-a4ccb8ce984d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:37.643614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb804e-e46c-4bb1-8f7a-7542a829e19f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:37.674469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30707d96-cd4f-428e-b236-a4ccb8ce984d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:37.678800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacd7ba-fe2c-430b-832c-543fd8f0502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:37.679450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacd7ba-fe2c-430b-832c-543fd8f0502d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.679740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacd7ba-fe2c-430b-832c-543fd8f0502d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.679998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacd7ba-fe2c-430b-832c-543fd8f0502d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.690730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacd7ba-fe2c-430b-832c-543fd8f0502d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5aacd7ba-fe2c-430b-832c-543fd8f0502d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:37.696598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:37.697648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:37.698428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 161/311] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:37.699066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacd7ba-fe2c-430b-832c-543fd8f0502d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:37.707839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:37.714830 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b8929-efd3-4184-a1f2-f170afc2a95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:37.715805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b8929-efd3-4184-a1f2-f170afc2a95e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.716096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b8929-efd3-4184-a1f2-f170afc2a95e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.716401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b8929-efd3-4184-a1f2-f170afc2a95e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.717501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b8929-efd3-4184-a1f2-f170afc2a95e None admin] RBAC: Adding query filter params (role.id=e7456e6d5b404412ad235b2bfeb1df9b, user.id=969d2815134c43949580fecd0d7e5382, scope.system=all) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:37.717965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b8929-efd3-4184-a1f2-f170afc2a95e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:37.719399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b8929-efd3-4184-a1f2-f170afc2a95e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:37.724949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 151/312] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 2 21:26:37 2022] GET /identity/v3/role_assignments?user.id=969d2815134c43949580fecd0d7e5382&scope.system=all&role.id=e7456e6d5b404412ad235b2bfeb1df9b => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:37.725741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b8929-efd3-4184-a1f2-f170afc2a95e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:37.755609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:37.830571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacd7ba-fe2c-430b-832c-543fd8f0502d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:37.881514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd57ae-bc68-462a-9e03-c652f23be407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:37.882198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd57ae-bc68-462a-9e03-c652f23be407 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.882474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd57ae-bc68-462a-9e03-c652f23be407 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.882743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd57ae-bc68-462a-9e03-c652f23be407 None admin] PATH_INFO: `/v3/groups` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.883550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd57ae-bc68-462a-9e03-c652f23be407 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:37.884949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd57ae-bc68-462a-9e03-c652f23be407 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:37.894583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b8929-efd3-4184-a1f2-f170afc2a95e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:37.904970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 162/313] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Aug 2 21:26:37 2022] POST /identity/v3/groups => generated 229 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:37.935840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c863de9-ed8d-40ce-b472-ff20576fe303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:37.936717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c863de9-ed8d-40ce-b472-ff20576fe303 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:37.937096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c863de9-ed8d-40ce-b472-ff20576fe303 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:37.937497 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c863de9-ed8d-40ce-b472-ff20576fe303 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:37.938384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c863de9-ed8d-40ce-b472-ff20576fe303 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:37.938791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c863de9-ed8d-40ce-b472-ff20576fe303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:37.940400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c863de9-ed8d-40ce-b472-ff20576fe303 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:37.951982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 152/314] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:37.958127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd57ae-bc68-462a-9e03-c652f23be407 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:38.072310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd57ae-bc68-462a-9e03-c652f23be407 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:38.075075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:38.110203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e969f7-33e4-4cef-8d23-598a33947bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:38.110907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e969f7-33e4-4cef-8d23-598a33947bed None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:38.111190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e969f7-33e4-4cef-8d23-598a33947bed None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:38.111464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e969f7-33e4-4cef-8d23-598a33947bed None admin] PATH_INFO: `/v3/users/38aa28e1aedf4721be5f8efe8df0fd8f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:38.112669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e969f7-33e4-4cef-8d23-598a33947bed None admin] RBAC: Authorizing `identity:get_user(user_id=38aa28e1aedf4721be5f8efe8df0fd8f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:38.114100 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e969f7-33e4-4cef-8d23-598a33947bed None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:38.116440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 163/315] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:37 2022] GET /identity/v3/users/38aa28e1aedf4721be5f8efe8df0fd8f => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:38.121717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c863de9-ed8d-40ce-b472-ff20576fe303 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:38.183728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:38.237452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c863de9-ed8d-40ce-b472-ff20576fe303 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:38.279144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79f62-e4af-4dc0-9992-2ce1ec970cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:38.280008 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79f62-e4af-4dc0-9992-2ce1ec970cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:38.280697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79f62-e4af-4dc0-9992-2ce1ec970cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:38.281129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a79f62-e4af-4dc0-9992-2ce1ec970cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:38.349508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79f62-e4af-4dc0-9992-2ce1ec970cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:38.351788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a79f62-e4af-4dc0-9992-2ce1ec970cc1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:38.407868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:38.455181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 153/316] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:38.461946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e969f7-33e4-4cef-8d23-598a33947bed None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:38.578170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e969f7-33e4-4cef-8d23-598a33947bed None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:38.612760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad1a95-7c5d-4b4f-a3d7-3566379fabee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:38.613614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad1a95-7c5d-4b4f-a3d7-3566379fabee None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:38.614030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad1a95-7c5d-4b4f-a3d7-3566379fabee None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:38.614486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad1a95-7c5d-4b4f-a3d7-3566379fabee None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:38.616439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad1a95-7c5d-4b4f-a3d7-3566379fabee None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:38.618018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad1a95-7c5d-4b4f-a3d7-3566379fabee None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:38.620087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 164/317] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:38 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:38.626054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79f62-e4af-4dc0-9992-2ce1ec970cc1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:38.726576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a79f62-e4af-4dc0-9992-2ce1ec970cc1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:38.761221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111fe886-eec7-478e-a664-c5da7b6ec0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:38.762058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe886-eec7-478e-a664-c5da7b6ec0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:38.762490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe886-eec7-478e-a664-c5da7b6ec0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:38.763141 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fe886-eec7-478e-a664-c5da7b6ec0f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:38.764053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe886-eec7-478e-a664-c5da7b6ec0f6 None admin] RBAC: Adding query filter params (role.id=e7456e6d5b404412ad235b2bfeb1df9b, scope.project.id=b2306424887947e5938736c5bbfeabb6, user.id=38aa28e1aedf4721be5f8efe8df0fd8f) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:38.764537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe886-eec7-478e-a664-c5da7b6ec0f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:38.766170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111fe886-eec7-478e-a664-c5da7b6ec0f6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:38.773129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 154/318] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:26:38 2022] GET /identity/v3/role_assignments?user.id=38aa28e1aedf4721be5f8efe8df0fd8f&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=e7456e6d5b404412ad235b2bfeb1df9b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:39.366810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1b2c8-0ef6-4eec-a3f8-741e4282560e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:39.367346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1b2c8-0ef6-4eec-a3f8-741e4282560e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:39.367346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1b2c8-0ef6-4eec-a3f8-741e4282560e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:39.369034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 165/319] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:39.374113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395edbe-c01c-470f-8a53-74864a628833 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:39.374401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395edbe-c01c-470f-8a53-74864a628833 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:39.374676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395edbe-c01c-470f-8a53-74864a628833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:39.393039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f395edbe-c01c-470f-8a53-74864a628833 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:39.394222 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f395edbe-c01c-470f-8a53-74864a628833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:39.409604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:39.465259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 155/320] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:39.487814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1b2c8-0ef6-4eec-a3f8-741e4282560e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:39.530023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:39.587510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1b2c8-0ef6-4eec-a3f8-741e4282560e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:39.620451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58656502-45bd-452a-8491-94ab5846183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:39.621015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58656502-45bd-452a-8491-94ab5846183f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:39.621294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58656502-45bd-452a-8491-94ab5846183f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:39.621564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58656502-45bd-452a-8491-94ab5846183f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:39.631834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58656502-45bd-452a-8491-94ab5846183f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-58656502-45bd-452a-8491-94ab5846183f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:39.636813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:39.637651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:39.638398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:39.642744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 166/321] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:39.644117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395edbe-c01c-470f-8a53-74864a628833 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:39.742230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395edbe-c01c-470f-8a53-74864a628833 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:39.775673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d155f-a65a-4ff4-a8e7-31645af19bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:39.776320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d155f-a65a-4ff4-a8e7-31645af19bbc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:39.776602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d155f-a65a-4ff4-a8e7-31645af19bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:39.776875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d155f-a65a-4ff4-a8e7-31645af19bbc None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:39.777583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d155f-a65a-4ff4-a8e7-31645af19bbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:39.777885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d155f-a65a-4ff4-a8e7-31645af19bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:39.779263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d155f-a65a-4ff4-a8e7-31645af19bbc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:39.787802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 156/322] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:39.793278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58656502-45bd-452a-8491-94ab5846183f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:39.846527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb5ac1-c88a-4139-8c8b-c33200a646de None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:39.846968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb5ac1-c88a-4139-8c8b-c33200a646de None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:39.847377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb5ac1-c88a-4139-8c8b-c33200a646de None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:39.848968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 157/323] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:39.854765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037753b-3821-42d2-ba7c-13bbad0eda1c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:39.855048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037753b-3821-42d2-ba7c-13bbad0eda1c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:39.855320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037753b-3821-42d2-ba7c-13bbad0eda1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:39.874134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6037753b-3821-42d2-ba7c-13bbad0eda1c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:39.875274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6037753b-3821-42d2-ba7c-13bbad0eda1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:39.882625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:39.905075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:39.908351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58656502-45bd-452a-8491-94ab5846183f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:39.945437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb7af-0836-4c4e-9749-37d52900271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:39.946080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb7af-0836-4c4e-9749-37d52900271d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:39.946360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb7af-0836-4c4e-9749-37d52900271d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:39.946630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eefb7af-0836-4c4e-9749-37d52900271d None admin] PATH_INFO: `/v3/users/c87048a0ae4c42d28f94787f1e29cc34` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:39.947219 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 158/324] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:39.948927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb7af-0836-4c4e-9749-37d52900271d None admin] RBAC: Authorizing `identity:get_user(user_id=c87048a0ae4c42d28f94787f1e29cc34)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:39.950447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eefb7af-0836-4c4e-9749-37d52900271d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:39.956267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 167/325] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:39 2022] GET /identity/v3/users/c87048a0ae4c42d28f94787f1e29cc34 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:39.957929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037753b-3821-42d2-ba7c-13bbad0eda1c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:39.968650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb7af-0836-4c4e-9749-37d52900271d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:40.063485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037753b-3821-42d2-ba7c-13bbad0eda1c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:40.074627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eefb7af-0836-4c4e-9749-37d52900271d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:40.100336 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd778f5f-52b2-42b3-8215-fe70468d5cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:40.100947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778f5f-52b2-42b3-8215-fe70468d5cfd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:40.101223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778f5f-52b2-42b3-8215-fe70468d5cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:40.101498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd778f5f-52b2-42b3-8215-fe70468d5cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:40.102271 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd778f5f-52b2-42b3-8215-fe70468d5cfd None admin] RBAC: Adding query filter params (role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, user.id=c87048a0ae4c42d28f94787f1e29cc34, scope.system=all) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:40.102575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd778f5f-52b2-42b3-8215-fe70468d5cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:40.103997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd778f5f-52b2-42b3-8215-fe70468d5cfd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:40.108295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb45ee-32ac-41b4-aa43-e78f245093b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:40.108927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb45ee-32ac-41b4-aa43-e78f245093b3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:40.109201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb45ee-32ac-41b4-aa43-e78f245093b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:40.109466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb45ee-32ac-41b4-aa43-e78f245093b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:40.112628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:40.117621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 159/326] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 2 21:26:39 2022] GET /identity/v3/role_assignments?user.id=c87048a0ae4c42d28f94787f1e29cc34&scope.system=all&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:40.118998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fd20d-caca-4c29-b927-563c0c9e7549 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:40.119413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fd20d-caca-4c29-b927-563c0c9e7549 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:40.119889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fd20d-caca-4c29-b927-563c0c9e7549 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:40.120287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb45ee-32ac-41b4-aa43-e78f245093b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:40.121398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 160/327] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:40.126972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190bea0-30cf-4c29-983f-025a023ef08f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:40.127184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190bea0-30cf-4c29-983f-025a023ef08f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:40.127577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190bea0-30cf-4c29-983f-025a023ef08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-1bdb45ee-32ac-41b4-aa43-e78f245093b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:40.128470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:40.129315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:40.130086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:40.134853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 168/328] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:40.135843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb45ee-32ac-41b4-aa43-e78f245093b3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:40.150695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6190bea0-30cf-4c29-983f-025a023ef08f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:40.151940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6190bea0-30cf-4c29-983f-025a023ef08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:40.167970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:40.230249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 161/329] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:40.249684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb45ee-32ac-41b4-aa43-e78f245093b3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:40.252756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190bea0-30cf-4c29-983f-025a023ef08f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:40.296088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981c3ae-60da-48b7-a9d8-34210aae9fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:40.297011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981c3ae-60da-48b7-a9d8-34210aae9fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:40.297297 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981c3ae-60da-48b7-a9d8-34210aae9fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:40.297572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981c3ae-60da-48b7-a9d8-34210aae9fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:40.298299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981c3ae-60da-48b7-a9d8-34210aae9fd2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:40.298609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981c3ae-60da-48b7-a9d8-34210aae9fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:40.300013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4981c3ae-60da-48b7-a9d8-34210aae9fd2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:40.308667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 169/330] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:40.314090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981c3ae-60da-48b7-a9d8-34210aae9fd2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:40.370665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190bea0-30cf-4c29-983f-025a023ef08f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:40.399130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:40.404246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:40.409014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20b16d-23ab-4d74-8770-185035c29bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:40.409659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20b16d-23ab-4d74-8770-185035c29bea None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:40.409931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20b16d-23ab-4d74-8770-185035c29bea None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:40.410194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e20b16d-23ab-4d74-8770-185035c29bea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:40.411316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20b16d-23ab-4d74-8770-185035c29bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:40.413319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e20b16d-23ab-4d74-8770-185035c29bea None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:40.414896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 162/331] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:40.415722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4981c3ae-60da-48b7-a9d8-34210aae9fd2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:40.420330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20b16d-23ab-4d74-8770-185035c29bea None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:40.449288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0c71-2ae3-481d-a143-4cee1f2a02a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:40.450121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0c71-2ae3-481d-a143-4cee1f2a02a9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:40.450403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0c71-2ae3-481d-a143-4cee1f2a02a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:40.450681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a0c71-2ae3-481d-a143-4cee1f2a02a9 None admin] PATH_INFO: `/v3/users/969d2815134c43949580fecd0d7e5382` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:40.451863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a0c71-2ae3-481d-a143-4cee1f2a02a9 None admin] RBAC: Authorizing `identity:get_user(user_id=969d2815134c43949580fecd0d7e5382)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:40.453342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a0c71-2ae3-481d-a143-4cee1f2a02a9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:40.454925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 170/332] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:40 2022] GET /identity/v3/users/969d2815134c43949580fecd0d7e5382 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:40.461424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0c71-2ae3-481d-a143-4cee1f2a02a9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:40.517491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e20b16d-23ab-4d74-8770-185035c29bea None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:40.552253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932fb3d-ed46-4147-8535-56fb8d02a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:40.552891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fb3d-ed46-4147-8535-56fb8d02a09f None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:40.553165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fb3d-ed46-4147-8535-56fb8d02a09f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:40.553428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932fb3d-ed46-4147-8535-56fb8d02a09f None admin] PATH_INFO: `/v3/groups` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:40.554081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932fb3d-ed46-4147-8535-56fb8d02a09f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:40.555500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3932fb3d-ed46-4147-8535-56fb8d02a09f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:40.557408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a0c71-2ae3-481d-a143-4cee1f2a02a9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:40.572392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 163/333] 10.222.0.57 () {60 vars in 1134 bytes} [Tue Aug 2 21:26:40 2022] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:26:40.592915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5387666-a47f-414e-af3a-19f3a0613f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:40.593606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387666-a47f-414e-af3a-19f3a0613f77 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:40.593893 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387666-a47f-414e-af3a-19f3a0613f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:40.594174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5387666-a47f-414e-af3a-19f3a0613f77 None admin] PATH_INFO: `/v3/system/users/969d2815134c43949580fecd0d7e5382/roles/e7456e6d5b404412ad235b2bfeb1df9b` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:40.595786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387666-a47f-414e-af3a-19f3a0613f77 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=969d2815134c43949580fecd0d7e5382, role_id=e7456e6d5b404412ad235b2bfeb1df9b)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:40.597264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5387666-a47f-414e-af3a-19f3a0613f77 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:40.605506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 171/334] 10.222.0.57 () {58 vars in 1334 bytes} [Tue Aug 2 21:26:40 2022] PUT /identity/v3/system/users/969d2815134c43949580fecd0d7e5382/roles/e7456e6d5b404412ad235b2bfeb1df9b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:26:42.842998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9ca5-f65d-4edc-9ad0-480e19958aa1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:42.843492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9ca5-f65d-4edc-9ad0-480e19958aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:42.843564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297c9ca5-f65d-4edc-9ad0-480e19958aa1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:42.845201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 164/335] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:42.850943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea67b1f-3e46-4929-bb0d-ef3fe9c6a306 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:42.851763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea67b1f-3e46-4929-bb0d-ef3fe9c6a306 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:42.852254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea67b1f-3e46-4929-bb0d-ef3fe9c6a306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:42.876044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3ea67b1f-3e46-4929-bb0d-ef3fe9c6a306 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:42.877705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3ea67b1f-3e46-4929-bb0d-ef3fe9c6a306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:42.900858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:42.965193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 172/336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:42.995950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9ca5-f65d-4edc-9ad0-480e19958aa1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:43.079490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:43.130048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297c9ca5-f65d-4edc-9ad0-480e19958aa1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:43.170335 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b47b27-1def-4606-9fde-ea10173353fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:43.171049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47b27-1def-4606-9fde-ea10173353fa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.171334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47b27-1def-4606-9fde-ea10173353fa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.171604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b47b27-1def-4606-9fde-ea10173353fa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.186866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b47b27-1def-4606-9fde-ea10173353fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-27b47b27-1def-4606-9fde-ea10173353fa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:43.192512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:43.193869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:26:43.194623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:43.198704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 165/337] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:43.200017 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea67b1f-3e46-4929-bb0d-ef3fe9c6a306 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:43.273578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d1d05-dc83-49a9-859d-f74bf8d54088 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.274209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d1d05-dc83-49a9-859d-f74bf8d54088 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.274703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d1d05-dc83-49a9-859d-f74bf8d54088 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.276659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 166/338] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:43.282518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041fe36-491d-4764-9644-9126ef801099 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.283044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041fe36-491d-4764-9644-9126ef801099 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.283511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041fe36-491d-4764-9644-9126ef801099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.321173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2041fe36-491d-4764-9644-9126ef801099 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:43.322847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2041fe36-491d-4764-9644-9126ef801099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:43.386995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea67b1f-3e46-4929-bb0d-ef3fe9c6a306 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:43.441794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 167/339] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:43.450708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07a289-868c-431f-90d4-964aeb8812f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:43.451343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07a289-868c-431f-90d4-964aeb8812f7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.451623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07a289-868c-431f-90d4-964aeb8812f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.451890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa07a289-868c-431f-90d4-964aeb8812f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.452638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07a289-868c-431f-90d4-964aeb8812f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:43.452944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07a289-868c-431f-90d4-964aeb8812f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:43.454320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa07a289-868c-431f-90d4-964aeb8812f7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:43.468853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 173/340] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:43.473862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041fe36-491d-4764-9644-9126ef801099 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:43.493195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07a289-868c-431f-90d4-964aeb8812f7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:43.522911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:43.551872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:43.653387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041fe36-491d-4764-9644-9126ef801099 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:43.673870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa07a289-868c-431f-90d4-964aeb8812f7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:43.720953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd68c3-7107-47fa-a77c-ef9e9c1d4623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:43.721674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd68c3-7107-47fa-a77c-ef9e9c1d4623 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.722451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd68c3-7107-47fa-a77c-ef9e9c1d4623 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.722451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd68c3-7107-47fa-a77c-ef9e9c1d4623 None admin] PATH_INFO: `/v3/users/969d2815134c43949580fecd0d7e5382` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.723362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3b150-213d-4b49-9238-3ccb5aec5a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:43.723554 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd68c3-7107-47fa-a77c-ef9e9c1d4623 None admin] RBAC: Authorizing `identity:get_user(user_id=969d2815134c43949580fecd0d7e5382)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:43.724941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b150-213d-4b49-9238-3ccb5aec5a58 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.725436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b150-213d-4b49-9238-3ccb5aec5a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.725537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd68c3-7107-47fa-a77c-ef9e9c1d4623 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:43.726000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3b150-213d-4b49-9238-3ccb5aec5a58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.728196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 168/341] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:43 2022] GET /identity/v3/users/969d2815134c43949580fecd0d7e5382 => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:43.732024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3cbeb-8ef3-4aca-afb7-5d045fe49fe7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.732024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3cbeb-8ef3-4aca-afb7-5d045fe49fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.732024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3cbeb-8ef3-4aca-afb7-5d045fe49fe7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.732024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 169/342] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:43.732024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffba041-9746-4dfe-ac02-4b6189223364 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.732024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffba041-9746-4dfe-ac02-4b6189223364 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.732426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffba041-9746-4dfe-ac02-4b6189223364 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.736017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 170/343] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:43.738096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffba041-9746-4dfe-ac02-4b6189223364 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:43.753049 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3b150-213d-4b49-9238-3ccb5aec5a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-6ce3b150-213d-4b49-9238-3ccb5aec5a58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:43.758926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:43.759774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:43.760586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:43.762869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 174/344] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:43.766466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286723f-1a18-43c1-bb2e-ae7c7d779317 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.766991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286723f-1a18-43c1-bb2e-ae7c7d779317 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.767471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286723f-1a18-43c1-bb2e-ae7c7d779317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.795080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e286723f-1a18-43c1-bb2e-ae7c7d779317 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:43.796782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e286723f-1a18-43c1-bb2e-ae7c7d779317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:43.876980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffba041-9746-4dfe-ac02-4b6189223364 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:43.904246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 175/345] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:43.905812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:43.907879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e013c4e-616d-4802-b6ad-a66bf3077788 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.908403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e013c4e-616d-4802-b6ad-a66bf3077788 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.908836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e013c4e-616d-4802-b6ad-a66bf3077788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.921505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:43.934683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8f02-7b8d-43a8-9e2d-8568279915b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:43.935662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8f02-7b8d-43a8-9e2d-8568279915b2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:43.936515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8f02-7b8d-43a8-9e2d-8568279915b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:43.936804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8f02-7b8d-43a8-9e2d-8568279915b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:43.937891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8f02-7b8d-43a8-9e2d-8568279915b2 None admin] RBAC: Adding query filter params (role.id=e7456e6d5b404412ad235b2bfeb1df9b, user.id=969d2815134c43949580fecd0d7e5382, scope.system=all) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:43.938229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8f02-7b8d-43a8-9e2d-8568279915b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:43.939666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8f02-7b8d-43a8-9e2d-8568279915b2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:43.943199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7e013c4e-616d-4802-b6ad-a66bf3077788 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:43.946942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7e013c4e-616d-4802-b6ad-a66bf3077788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:43.964317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 171/346] 10.222.0.57 () {56 vars in 1308 bytes} [Tue Aug 2 21:26:43 2022] GET /identity/v3/role_assignments?user.id=969d2815134c43949580fecd0d7e5382&scope.system=all&role.id=e7456e6d5b404412ad235b2bfeb1df9b => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:43.965595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8f02-7b8d-43a8-9e2d-8568279915b2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:44.063596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 176/347] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:44.064851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e013c4e-616d-4802-b6ad-a66bf3077788 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:44.127997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8f02-7b8d-43a8-9e2d-8568279915b2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:44.177797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0e5a4-a185-47f7-bbf6-d729d6bfa2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:44.179211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0e5a4-a185-47f7-bbf6-d729d6bfa2ca None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:44.179946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0e5a4-a185-47f7-bbf6-d729d6bfa2ca None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:44.180460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe0e5a4-a185-47f7-bbf6-d729d6bfa2ca None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:44.184696 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0e5a4-a185-47f7-bbf6-d729d6bfa2ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:44.185450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0e5a4-a185-47f7-bbf6-d729d6bfa2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:44.189108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe0e5a4-a185-47f7-bbf6-d729d6bfa2ca None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:44.202613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 172/348] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:44.204617 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0e5a4-a185-47f7-bbf6-d729d6bfa2ca None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:44.206283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e013c4e-616d-4802-b6ad-a66bf3077788 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:44.252725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fe568-3ebd-40c3-b383-fe518693161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:44.253881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fe568-3ebd-40c3-b383-fe518693161e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:44.254369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fe568-3ebd-40c3-b383-fe518693161e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:44.254861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fe568-3ebd-40c3-b383-fe518693161e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:44.257572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:44.259547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:44.274392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fe568-3ebd-40c3-b383-fe518693161e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b59fe568-3ebd-40c3-b383-fe518693161e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:44.281006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:44.281968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:44.282744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:44.285615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 177/349] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:44.286503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fe568-3ebd-40c3-b383-fe518693161e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:44.349113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe0e5a4-a185-47f7-bbf6-d729d6bfa2ca None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:44.390178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192517c-7844-4237-a704-7e1f948fda0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:44.390818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192517c-7844-4237-a704-7e1f948fda0a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:44.391483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192517c-7844-4237-a704-7e1f948fda0a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:44.391483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192517c-7844-4237-a704-7e1f948fda0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:44.408901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192517c-7844-4237-a704-7e1f948fda0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2192517c-7844-4237-a704-7e1f948fda0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:44.414588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:44.415447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:44.416243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:44.416817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 173/350] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:44.417459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192517c-7844-4237-a704-7e1f948fda0a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:44.431640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fe568-3ebd-40c3-b383-fe518693161e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:44.479343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e736b-87c8-4d61-a666-1e00559f8102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:44.479979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e736b-87c8-4d61-a666-1e00559f8102 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:44.480299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e736b-87c8-4d61-a666-1e00559f8102 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:44.480573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e736b-87c8-4d61-a666-1e00559f8102 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:44.549140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:44.555347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192517c-7844-4237-a704-7e1f948fda0a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:44.563913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:44.575881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e736b-87c8-4d61-a666-1e00559f8102 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:44.577448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e736b-87c8-4d61-a666-1e00559f8102 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:44.603687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594295cc-3ade-4352-9ecd-f5832810505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:44.604775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594295cc-3ade-4352-9ecd-f5832810505a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:44.605262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594295cc-3ade-4352-9ecd-f5832810505a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:44.605726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594295cc-3ade-4352-9ecd-f5832810505a None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:44.606606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594295cc-3ade-4352-9ecd-f5832810505a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:44.606917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594295cc-3ade-4352-9ecd-f5832810505a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:44.608320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594295cc-3ade-4352-9ecd-f5832810505a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:44.617932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 174/351] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:44.618319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594295cc-3ade-4352-9ecd-f5832810505a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:44.690996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 178/352] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:44.692229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7350e35-425c-4192-83ae-5b30861abb19 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:44.692515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7350e35-425c-4192-83ae-5b30861abb19 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:44.692785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7350e35-425c-4192-83ae-5b30861abb19 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:44.694841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 179/353] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:44.695550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7350e35-425c-4192-83ae-5b30861abb19 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:44.754229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594295cc-3ade-4352-9ecd-f5832810505a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:44.798375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0ccc-2480-4979-b6a8-d55831edddc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:44.799004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0ccc-2480-4979-b6a8-d55831edddc5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:44.799360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0ccc-2480-4979-b6a8-d55831edddc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:44.799547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d0ccc-2480-4979-b6a8-d55831edddc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:44.800294 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0ccc-2480-4979-b6a8-d55831edddc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:44.800602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0ccc-2480-4979-b6a8-d55831edddc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:44.802213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d0ccc-2480-4979-b6a8-d55831edddc5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:44.819954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 175/354] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:44.820848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0ccc-2480-4979-b6a8-d55831edddc5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:44.823745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:44.836484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7350e35-425c-4192-83ae-5b30861abb19 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:44.847904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:44.885975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13599b9-7fba-4839-8e1a-b778d7d6c747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:44.886750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13599b9-7fba-4839-8e1a-b778d7d6c747 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:44.887033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13599b9-7fba-4839-8e1a-b778d7d6c747 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:44.887354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13599b9-7fba-4839-8e1a-b778d7d6c747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:44.956160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d0ccc-2480-4979-b6a8-d55831edddc5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:44.973576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13599b9-7fba-4839-8e1a-b778d7d6c747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:44.975167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13599b9-7fba-4839-8e1a-b778d7d6c747 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:44.998109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab30e6-2d0d-4145-9a3a-267bb57c73cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:44.998766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab30e6-2d0d-4145-9a3a-267bb57c73cc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:44.999047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab30e6-2d0d-4145-9a3a-267bb57c73cc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:44.999321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab30e6-2d0d-4145-9a3a-267bb57c73cc None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.001130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab30e6-2d0d-4145-9a3a-267bb57c73cc None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:45.002578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ab30e6-2d0d-4145-9a3a-267bb57c73cc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:45.004410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 176/355] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:44 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:45.005426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f5506-8ff3-409b-acd6-d64b7cf3e2f2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.006264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f5506-8ff3-409b-acd6-d64b7cf3e2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.006539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f5506-8ff3-409b-acd6-d64b7cf3e2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.024847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8f7f5506-8ff3-409b-acd6-d64b7cf3e2f2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:45.026040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8f7f5506-8ff3-409b-acd6-d64b7cf3e2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:45.082443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:45.092337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 180/356] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:45.092337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13599b9-7fba-4839-8e1a-b778d7d6c747 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:45.109399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 177/357] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:45.110811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca8f2-cadf-4409-8908-731d30add590 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.111101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca8f2-cadf-4409-8908-731d30add590 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.111379 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca8f2-cadf-4409-8908-731d30add590 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.112661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 178/358] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:45.113350 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ca8f2-cadf-4409-8908-731d30add590 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:45.139321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:45.209575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13599b9-7fba-4839-8e1a-b778d7d6c747 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:45.235481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ca8f2-cadf-4409-8908-731d30add590 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:45.251495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2391bd-e23c-4725-9cbd-b918dd4787b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:45.252125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2391bd-e23c-4725-9cbd-b918dd4787b4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.252739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2391bd-e23c-4725-9cbd-b918dd4787b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.252739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2391bd-e23c-4725-9cbd-b918dd4787b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.273989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b425-2f28-49df-9686-307631ab5c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:45.274347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b425-2f28-49df-9686-307631ab5c60 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.274623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b425-2f28-49df-9686-307631ab5c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.274895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91b425-2f28-49df-9686-307631ab5c60 None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.282135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91b425-2f28-49df-9686-307631ab5c60 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:45.283673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91b425-2f28-49df-9686-307631ab5c60 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:45.286514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 179/359] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:45 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:45.288384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b425-2f28-49df-9686-307631ab5c60 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:45.329878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:45.338832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2391bd-e23c-4725-9cbd-b918dd4787b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:45.340115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2391bd-e23c-4725-9cbd-b918dd4787b4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:45.388965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:45.413155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91b425-2f28-49df-9686-307631ab5c60 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:45.454411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c6faa-c289-45b5-b344-92aef430a8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:45.454411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c6faa-c289-45b5-b344-92aef430a8bf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.454411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c6faa-c289-45b5-b344-92aef430a8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.454801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c6faa-c289-45b5-b344-92aef430a8bf None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.455973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c6faa-c289-45b5-b344-92aef430a8bf None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:45.457545 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42c6faa-c289-45b5-b344-92aef430a8bf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:45.459370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 180/360] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:45 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:45.460655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1279-2953-4f2a-8148-e51c4e51392b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.460888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1279-2953-4f2a-8148-e51c4e51392b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.461161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c1279-2953-4f2a-8148-e51c4e51392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.471761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 181/361] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:45.471761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2391bd-e23c-4725-9cbd-b918dd4787b4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:45.481884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-816c1279-2953-4f2a-8148-e51c4e51392b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:45.484352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-816c1279-2953-4f2a-8148-e51c4e51392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:45.563680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 181/362] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:45.564586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1279-2953-4f2a-8148-e51c4e51392b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:45.579280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:45.591456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2391bd-e23c-4725-9cbd-b918dd4787b4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:45.632629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006823c-16e6-48dd-86ce-140bde46fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:45.633652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006823c-16e6-48dd-86ce-140bde46fb5e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.634003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006823c-16e6-48dd-86ce-140bde46fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.634374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006823c-16e6-48dd-86ce-140bde46fb5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.650325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0006823c-16e6-48dd-86ce-140bde46fb5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-0006823c-16e6-48dd-86ce-140bde46fb5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:45.655539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:45.656447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:45.657230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 182/363] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:45.657877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006823c-16e6-48dd-86ce-140bde46fb5e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:45.667616 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:45.690438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c1279-2953-4f2a-8148-e51c4e51392b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:45.731159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fcf69-5f18-4004-80d8-c993c7d4d5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:45.732067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fcf69-5f18-4004-80d8-c993c7d4d5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.732381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fcf69-5f18-4004-80d8-c993c7d4d5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.732658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fcf69-5f18-4004-80d8-c993c7d4d5d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.733481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fcf69-5f18-4004-80d8-c993c7d4d5d9 None admin] RBAC: Adding query filter params (group.id=5b7470692e1a4f61b34f70a3c62de297, role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=729d3dec279d497d9feb72ae57cadd8c) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:45.733797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fcf69-5f18-4004-80d8-c993c7d4d5d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:45.735250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fcf69-5f18-4004-80d8-c993c7d4d5d9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:45.741431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 182/364] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:45 2022] GET /identity/v3/role_assignments?group.id=5b7470692e1a4f61b34f70a3c62de297&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:45.742317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fcf69-5f18-4004-80d8-c993c7d4d5d9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:45.777622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0006823c-16e6-48dd-86ce-140bde46fb5e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:45.837170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d98f71-908a-4392-a8e8-2786cd5f8fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:45.837825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d98f71-908a-4392-a8e8-2786cd5f8fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.838105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d98f71-908a-4392-a8e8-2786cd5f8fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.838375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d98f71-908a-4392-a8e8-2786cd5f8fc4 None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.841007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d98f71-908a-4392-a8e8-2786cd5f8fc4 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:45.842127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d98f71-908a-4392-a8e8-2786cd5f8fc4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:45.848212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 183/365] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:45 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:45.850201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d98f71-908a-4392-a8e8-2786cd5f8fc4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:45.879425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:45.884421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fcf69-5f18-4004-80d8-c993c7d4d5d9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:45.931903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d650add-629f-4a19-8949-0f2b5d60af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:45.933061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d650add-629f-4a19-8949-0f2b5d60af9f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:45.933423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d650add-629f-4a19-8949-0f2b5d60af9f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:45.933707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d650add-629f-4a19-8949-0f2b5d60af9f None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:45.935780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d650add-629f-4a19-8949-0f2b5d60af9f None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:45.937265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d650add-629f-4a19-8949-0f2b5d60af9f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:45.939875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 183/366] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:45 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:45.940797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d650add-629f-4a19-8949-0f2b5d60af9f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:45.961730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:45.973923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d98f71-908a-4392-a8e8-2786cd5f8fc4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:46.016988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870c8de-2220-4fe6-964d-71549d2f420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:46.017816 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870c8de-2220-4fe6-964d-71549d2f420f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.017924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870c8de-2220-4fe6-964d-71549d2f420f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.018202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870c8de-2220-4fe6-964d-71549d2f420f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.030582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870c8de-2220-4fe6-964d-71549d2f420f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c870c8de-2220-4fe6-964d-71549d2f420f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:46.035509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:46.036427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:46.037256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 184/367] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:46.037882 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870c8de-2220-4fe6-964d-71549d2f420f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:46.066483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d650add-629f-4a19-8949-0f2b5d60af9f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:46.108393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea42d-86cb-4caa-94d9-014ba133192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:46.109026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea42d-86cb-4caa-94d9-014ba133192a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.109658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea42d-86cb-4caa-94d9-014ba133192a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.109944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ea42d-86cb-4caa-94d9-014ba133192a None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.110820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ea42d-86cb-4caa-94d9-014ba133192a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:46.111133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ea42d-86cb-4caa-94d9-014ba133192a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:46.112536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ea42d-86cb-4caa-94d9-014ba133192a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:46.122936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 184/368] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:46.123765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea42d-86cb-4caa-94d9-014ba133192a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:46.143201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:46.172963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870c8de-2220-4fe6-964d-71549d2f420f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:46.212888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0ee42-8836-4fb2-aa37-751f7f32b446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:46.213540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0ee42-8836-4fb2-aa37-751f7f32b446 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.213824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0ee42-8836-4fb2-aa37-751f7f32b446 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.214099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb0ee42-8836-4fb2-aa37-751f7f32b446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.214907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0ee42-8836-4fb2-aa37-751f7f32b446 None admin] RBAC: Adding query filter params (group.id=5b7470692e1a4f61b34f70a3c62de297, role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=729d3dec279d497d9feb72ae57cadd8c) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:46.215218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0ee42-8836-4fb2-aa37-751f7f32b446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:46.216718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb0ee42-8836-4fb2-aa37-751f7f32b446 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:46.223503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 185/369] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:46 2022] GET /identity/v3/role_assignments?group.id=5b7470692e1a4f61b34f70a3c62de297&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=67ac8da7e16f46b496e98633276e6909 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:46.224424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0ee42-8836-4fb2-aa37-751f7f32b446 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:46.253849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ea42d-86cb-4caa-94d9-014ba133192a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:46.273164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:46.303200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12b24d-1145-4b3b-9fb2-70d5d467a2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:46.304341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12b24d-1145-4b3b-9fb2-70d5d467a2cc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.304726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12b24d-1145-4b3b-9fb2-70d5d467a2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.305127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12b24d-1145-4b3b-9fb2-70d5d467a2cc None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.307735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12b24d-1145-4b3b-9fb2-70d5d467a2cc None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:46.309260 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12b24d-1145-4b3b-9fb2-70d5d467a2cc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:46.311061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 185/370] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:46 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:46.312265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12b24d-1145-4b3b-9fb2-70d5d467a2cc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:46.353881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb0ee42-8836-4fb2-aa37-751f7f32b446 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:46.394068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f810f-9cbd-4643-954a-bc88075c714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:46.394951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f810f-9cbd-4643-954a-bc88075c714b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.395535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f810f-9cbd-4643-954a-bc88075c714b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.395958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f810f-9cbd-4643-954a-bc88075c714b None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.397164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f810f-9cbd-4643-954a-bc88075c714b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:46.397692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f810f-9cbd-4643-954a-bc88075c714b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:46.399774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f810f-9cbd-4643-954a-bc88075c714b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:46.413291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 186/371] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:46.415218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f810f-9cbd-4643-954a-bc88075c714b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:46.429832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:46.474393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12b24d-1145-4b3b-9fb2-70d5d467a2cc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:46.521973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb621781-e33d-4666-82af-ce193bb05095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:46.523099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb621781-e33d-4666-82af-ce193bb05095 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.523650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb621781-e33d-4666-82af-ce193bb05095 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.524065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb621781-e33d-4666-82af-ce193bb05095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.529396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f810f-9cbd-4643-954a-bc88075c714b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:46.538309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:46.565536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322964-fef6-48f8-9a65-477a3224b68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:46.566312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322964-fef6-48f8-9a65-477a3224b68f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.566696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322964-fef6-48f8-9a65-477a3224b68f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.567564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0322964-fef6-48f8-9a65-477a3224b68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.568707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322964-fef6-48f8-9a65-477a3224b68f None admin] RBAC: Adding query filter params (group.id=5b7470692e1a4f61b34f70a3c62de297, role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=b2306424887947e5938736c5bbfeabb6) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:46.569122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322964-fef6-48f8-9a65-477a3224b68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:46.570658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0322964-fef6-48f8-9a65-477a3224b68f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:46.576767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 187/372] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:46 2022] GET /identity/v3/role_assignments?group.id=5b7470692e1a4f61b34f70a3c62de297&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:46.577518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322964-fef6-48f8-9a65-477a3224b68f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:46.606963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb621781-e33d-4666-82af-ce193bb05095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:46.608701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb621781-e33d-4666-82af-ce193bb05095 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:46.657892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:46.694961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0322964-fef6-48f8-9a65-477a3224b68f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:46.726808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 186/373] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:46.732522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb621781-e33d-4666-82af-ce193bb05095 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:46.733547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e420d-5ab0-43b5-9583-b191e08f46c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:46.734290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e420d-5ab0-43b5-9583-b191e08f46c2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.734683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e420d-5ab0-43b5-9583-b191e08f46c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.735057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e420d-5ab0-43b5-9583-b191e08f46c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.783771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:46.821584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e420d-5ab0-43b5-9583-b191e08f46c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:46.823329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e420d-5ab0-43b5-9583-b191e08f46c2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:46.853164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb621781-e33d-4666-82af-ce193bb05095 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:46.894572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f1919-1ee5-46e3-a8d0-e139ee7db982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:46.895907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f1919-1ee5-46e3-a8d0-e139ee7db982 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.897042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f1919-1ee5-46e3-a8d0-e139ee7db982 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.897512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f1919-1ee5-46e3-a8d0-e139ee7db982 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.899074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f1919-1ee5-46e3-a8d0-e139ee7db982 None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:46.900971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9f1919-1ee5-46e3-a8d0-e139ee7db982 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:46.903399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 187/374] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:46 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:46.909474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f1919-1ee5-46e3-a8d0-e139ee7db982 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:46.911329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:46.944562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 188/375] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:46.952026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e420d-5ab0-43b5-9583-b191e08f46c2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:47.018581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f1919-1ee5-46e3-a8d0-e139ee7db982 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:47.032518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:47.056691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e420d-5ab0-43b5-9583-b191e08f46c2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:47.057794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8c005-2e1a-4f1b-9f60-1c270a7f41ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:47.058819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8c005-2e1a-4f1b-9f60-1c270a7f41ed None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:47.059318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8c005-2e1a-4f1b-9f60-1c270a7f41ed None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:47.059786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b8c005-2e1a-4f1b-9f60-1c270a7f41ed None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:47.061255 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8c005-2e1a-4f1b-9f60-1c270a7f41ed None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:47.062894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b8c005-2e1a-4f1b-9f60-1c270a7f41ed None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:47.064871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 188/376] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:46 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:47.071599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8c005-2e1a-4f1b-9f60-1c270a7f41ed None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:47.095127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0b0f-e276-472d-b868-89cf5435a9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:47.095836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0b0f-e276-472d-b868-89cf5435a9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:47.096178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0b0f-e276-472d-b868-89cf5435a9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:47.096475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff0b0f-e276-472d-b868-89cf5435a9b2 None admin] PATH_INFO: `/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:47.097658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0b0f-e276-472d-b868-89cf5435a9b2 None admin] RBAC: Authorizing `identity:get_project(project_id=4a739ee2f7d746e0a37b1f7b651a505d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:47.099114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff0b0f-e276-472d-b868-89cf5435a9b2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:47.101047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 189/377] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:46 2022] GET /identity/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:47.106406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0b0f-e276-472d-b868-89cf5435a9b2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:47.189519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b8c005-2e1a-4f1b-9f60-1c270a7f41ed None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:47.227632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd43dba-ef64-472d-ba8a-afd891312164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:47.228756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd43dba-ef64-472d-ba8a-afd891312164 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:47.229274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd43dba-ef64-472d-ba8a-afd891312164 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:47.229886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd43dba-ef64-472d-ba8a-afd891312164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:47.230864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd43dba-ef64-472d-ba8a-afd891312164 None admin] RBAC: Adding query filter params (group.id=5b7470692e1a4f61b34f70a3c62de297, role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=b2306424887947e5938736c5bbfeabb6) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:47.231422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd43dba-ef64-472d-ba8a-afd891312164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:47.233092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd43dba-ef64-472d-ba8a-afd891312164 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:47.239400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 189/378] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:47 2022] GET /identity/v3/role_assignments?group.id=5b7470692e1a4f61b34f70a3c62de297&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=67ac8da7e16f46b496e98633276e6909 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:47.255045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:47.323113 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff0b0f-e276-472d-b868-89cf5435a9b2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:47.372241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e164ff4-4864-4cae-8daf-f9545b845b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:47.372899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e164ff4-4864-4cae-8daf-f9545b845b25 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:47.373178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e164ff4-4864-4cae-8daf-f9545b845b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:47.373452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e164ff4-4864-4cae-8daf-f9545b845b25 None admin] PATH_INFO: `/v3/groups/8fd3922f45ec4ecd9bc14ea25b960bbd` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:47.379741 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e164ff4-4864-4cae-8daf-f9545b845b25 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd3922f45ec4ecd9bc14ea25b960bbd)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:47.381320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e164ff4-4864-4cae-8daf-f9545b845b25 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:47.383441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 190/379] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:47 2022] GET /identity/v3/groups/8fd3922f45ec4ecd9bc14ea25b960bbd => generated 229 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:47.389079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd43dba-ef64-472d-ba8a-afd891312164 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:47.464714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:47.527699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd43dba-ef64-472d-ba8a-afd891312164 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:47.571137 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318bf28-7582-4d5d-b003-55d7869f2d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:47.571765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318bf28-7582-4d5d-b003-55d7869f2d16 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:47.572057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318bf28-7582-4d5d-b003-55d7869f2d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:47.576466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318bf28-7582-4d5d-b003-55d7869f2d16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:47.577290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318bf28-7582-4d5d-b003-55d7869f2d16 None admin] RBAC: Adding query filter params (group.id=8fd3922f45ec4ecd9bc14ea25b960bbd, role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=4a739ee2f7d746e0a37b1f7b651a505d) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:47.577609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318bf28-7582-4d5d-b003-55d7869f2d16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:47.579119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318bf28-7582-4d5d-b003-55d7869f2d16 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:47.585072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 190/380] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:47 2022] GET /identity/v3/role_assignments?group.id=8fd3922f45ec4ecd9bc14ea25b960bbd&scope.project.id=4a739ee2f7d746e0a37b1f7b651a505d&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:48.221369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6512c3-05e4-4d07-96dc-edf74bc5d631 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:48.222482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6512c3-05e4-4d07-96dc-edf74bc5d631 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:48.222971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6512c3-05e4-4d07-96dc-edf74bc5d631 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:48.224875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 191/381] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:48.230253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71b26b-5de4-40b4-ac66-6392577aa3b2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:48.231086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71b26b-5de4-40b4-ac66-6392577aa3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:48.231566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71b26b-5de4-40b4-ac66-6392577aa3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:48.249928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bc71b26b-5de4-40b4-ac66-6392577aa3b2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:48.251489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bc71b26b-5de4-40b4-ac66-6392577aa3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:48.341749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 191/382] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:48.371255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6512c3-05e4-4d07-96dc-edf74bc5d631 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:48.489074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6512c3-05e4-4d07-96dc-edf74bc5d631 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:48.492294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:48.536677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c166c-e1ee-4c53-b224-cd7876a59870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:48.537748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c166c-e1ee-4c53-b224-cd7876a59870 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:48.538028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c166c-e1ee-4c53-b224-cd7876a59870 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:48.538299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c166c-e1ee-4c53-b224-cd7876a59870 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:48.557229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c166c-e1ee-4c53-b224-cd7876a59870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-491c166c-e1ee-4c53-b224-cd7876a59870 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:48.562312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:48.563211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:48.564011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:48.569791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 192/383] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:48.575570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71b26b-5de4-40b4-ac66-6392577aa3b2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:48.618697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:48.697390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71b26b-5de4-40b4-ac66-6392577aa3b2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:48.746259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660679-cc01-456d-8c5b-0767609eb965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:48.746805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660679-cc01-456d-8c5b-0767609eb965 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:48.747085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660679-cc01-456d-8c5b-0767609eb965 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:48.747356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e660679-cc01-456d-8c5b-0767609eb965 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:48.748070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e660679-cc01-456d-8c5b-0767609eb965 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:48.748404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e660679-cc01-456d-8c5b-0767609eb965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:48.749763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e660679-cc01-456d-8c5b-0767609eb965 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:48.763407 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 192/384] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:48.769398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c166c-e1ee-4c53-b224-cd7876a59870 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:48.900005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c166c-e1ee-4c53-b224-cd7876a59870 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:48.938084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b0df9-d3b7-4522-a107-a4d7f4d29270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:48.938734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0df9-d3b7-4522-a107-a4d7f4d29270 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:48.939068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0df9-d3b7-4522-a107-a4d7f4d29270 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:48.939345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b0df9-d3b7-4522-a107-a4d7f4d29270 None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:48.940539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b0df9-d3b7-4522-a107-a4d7f4d29270 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:48.941981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b0df9-d3b7-4522-a107-a4d7f4d29270 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:48.944037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 193/385] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:48 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:48.949504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660679-cc01-456d-8c5b-0767609eb965 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:49.073470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e660679-cc01-456d-8c5b-0767609eb965 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:49.075206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed90f99-3102-4c39-a927-20f899dad6fa None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.075550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed90f99-3102-4c39-a927-20f899dad6fa None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.075804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:49.075904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed90f99-3102-4c39-a927-20f899dad6fa None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.077185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 194/386] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:49.082741 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ba662-e11d-4729-948b-8a3bebad9da2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.083064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ba662-e11d-4729-948b-8a3bebad9da2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.083339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ba662-e11d-4729-948b-8a3bebad9da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.116818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-382ba662-e11d-4729-948b-8a3bebad9da2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:49.118043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-382ba662-e11d-4729-948b-8a3bebad9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:49.140497 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067e86e-2f75-44af-b5af-9451da9e4127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:49.141146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067e86e-2f75-44af-b5af-9451da9e4127 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.141470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067e86e-2f75-44af-b5af-9451da9e4127 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.141750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1067e86e-2f75-44af-b5af-9451da9e4127 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.143041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067e86e-2f75-44af-b5af-9451da9e4127 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:49.144499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1067e86e-2f75-44af-b5af-9451da9e4127 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:49.153026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 193/387] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:48 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:49.157134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067e86e-2f75-44af-b5af-9451da9e4127 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:49.179063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:49.259201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 195/388] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:49.274241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a71b-9464-48cd-87e7-451a02b8e746 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.274770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a71b-9464-48cd-87e7-451a02b8e746 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.275189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80a71b-9464-48cd-87e7-451a02b8e746 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.277392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 196/389] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:49.290009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1269b0a-ac5f-44e1-b4c3-dfcb0016816e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.290574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1269b0a-ac5f-44e1-b4c3-dfcb0016816e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.291062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1269b0a-ac5f-44e1-b4c3-dfcb0016816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.304350 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1067e86e-2f75-44af-b5af-9451da9e4127 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:49.313574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d1269b0a-ac5f-44e1-b4c3-dfcb0016816e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:49.315616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d1269b0a-ac5f-44e1-b4c3-dfcb0016816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:49.341915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68708d0-bad9-4e33-af4c-99da88de873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:49.343064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68708d0-bad9-4e33-af4c-99da88de873d None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.343580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68708d0-bad9-4e33-af4c-99da88de873d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.344079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68708d0-bad9-4e33-af4c-99da88de873d None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c/groups/5b7470692e1a4f61b34f70a3c62de297/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.346474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68708d0-bad9-4e33-af4c-99da88de873d None admin] RBAC: Authorizing `identity:create_grant(project_id=729d3dec279d497d9feb72ae57cadd8c, group_id=5b7470692e1a4f61b34f70a3c62de297, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:49.348074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68708d0-bad9-4e33-af4c-99da88de873d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:49.364834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 194/390] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 21:26:49 2022] PUT /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c/groups/5b7470692e1a4f61b34f70a3c62de297/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:26:49.366010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68708d0-bad9-4e33-af4c-99da88de873d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:49.404386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 197/391] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:49.413339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:49.430573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1269b0a-ac5f-44e1-b4c3-dfcb0016816e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:49.564856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68708d0-bad9-4e33-af4c-99da88de873d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:49.578645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:49.588473 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1269b0a-ac5f-44e1-b4c3-dfcb0016816e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:49.605650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36fd9b-85a8-4632-9ef5-32630b66b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:49.606515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36fd9b-85a8-4632-9ef5-32630b66b015 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.606933 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36fd9b-85a8-4632-9ef5-32630b66b015 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.607353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36fd9b-85a8-4632-9ef5-32630b66b015 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.619970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36fd9b-85a8-4632-9ef5-32630b66b015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:49.626719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2009b-c887-4788-a87c-019f235de15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ea36fd9b-85a8-4632-9ef5-32630b66b015 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:49.627303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:49.628318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:49.629088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:49.629667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2009b-c887-4788-a87c-019f235de15f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.629667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2009b-c887-4788-a87c-019f235de15f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.629667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2009b-c887-4788-a87c-019f235de15f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.632161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 195/392] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:49.638064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36fd9b-85a8-4632-9ef5-32630b66b015 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:49.643262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b2009b-c887-4788-a87c-019f235de15f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-90b2009b-c887-4788-a87c-019f235de15f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:49.649052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:49.649904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:49.650721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 198/393] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:49.657170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2009b-c887-4788-a87c-019f235de15f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:49.754312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:49.773420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36fd9b-85a8-4632-9ef5-32630b66b015 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:49.778184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2009b-c887-4788-a87c-019f235de15f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:49.825819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a1581-d96b-462d-90c4-f74f49bd9cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:49.826822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1581-d96b-462d-90c4-f74f49bd9cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.827315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1581-d96b-462d-90c4-f74f49bd9cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.827799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a1581-d96b-462d-90c4-f74f49bd9cf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.827920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ba896-0b69-4bdc-810d-e776c4cf6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:49.828572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ba896-0b69-4bdc-810d-e776c4cf6834 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.828853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ba896-0b69-4bdc-810d-e776c4cf6834 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.829127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ba896-0b69-4bdc-810d-e776c4cf6834 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.829581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a1581-d96b-462d-90c4-f74f49bd9cf9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:49.829982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ba896-0b69-4bdc-810d-e776c4cf6834 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:49.830295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ba896-0b69-4bdc-810d-e776c4cf6834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:49.830402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a1581-d96b-462d-90c4-f74f49bd9cf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:49.831679 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170ba896-0b69-4bdc-810d-e776c4cf6834 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:49.832206 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a1581-d96b-462d-90c4-f74f49bd9cf9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:49.841440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 199/394] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:49.842663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d6503-9931-45a9-a50e-6cb1b40dbe81 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.842948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d6503-9931-45a9-a50e-6cb1b40dbe81 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.843223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794d6503-9931-45a9-a50e-6cb1b40dbe81 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.844623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 196/396] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:49.844753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 200/396] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:49.850159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b6979-9341-49a8-8125-7a22c190fb22 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.850634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a1581-d96b-462d-90c4-f74f49bd9cf9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:49.850854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b6979-9341-49a8-8125-7a22c190fb22 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.851308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b6979-9341-49a8-8125-7a22c190fb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.875310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2d9b6979-9341-49a8-8125-7a22c190fb22 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:49.877147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2d9b6979-9341-49a8-8125-7a22c190fb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:49.891636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:49.964016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a1581-d96b-462d-90c4-f74f49bd9cf9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:49.976202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 201/397] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:49.977375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b6979-9341-49a8-8125-7a22c190fb22 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.011429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e173-659c-4aaf-9e9b-ace52c7c3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.012371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e173-659c-4aaf-9e9b-ace52c7c3841 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.012929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e173-659c-4aaf-9e9b-ace52c7c3841 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.013354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5e173-659c-4aaf-9e9b-ace52c7c3841 None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.015230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e173-659c-4aaf-9e9b-ace52c7c3841 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:50.017347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5e173-659c-4aaf-9e9b-ace52c7c3841 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:50.020236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 197/398] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:49 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:50.021539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e173-659c-4aaf-9e9b-ace52c7c3841 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.044380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:50.095403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b6979-9341-49a8-8125-7a22c190fb22 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:50.137193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22a86-4fe6-44ee-bb97-e909a25462f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.138508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22a86-4fe6-44ee-bb97-e909a25462f7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.138983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22a86-4fe6-44ee-bb97-e909a25462f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.139484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22a86-4fe6-44ee-bb97-e909a25462f7 None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.141430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c22a86-4fe6-44ee-bb97-e909a25462f7 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:50.143376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c22a86-4fe6-44ee-bb97-e909a25462f7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:50.146570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 202/399] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:49 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:50.148257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22a86-4fe6-44ee-bb97-e909a25462f7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.154050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5e173-659c-4aaf-9e9b-ace52c7c3841 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:50.167818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:50.194306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdfe7a-4b73-435b-b2f2-77acf4d84df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.195082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdfe7a-4b73-435b-b2f2-77acf4d84df6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.195371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdfe7a-4b73-435b-b2f2-77acf4d84df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.195656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdfe7a-4b73-435b-b2f2-77acf4d84df6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.205959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acdfe7a-4b73-435b-b2f2-77acf4d84df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9acdfe7a-4b73-435b-b2f2-77acf4d84df6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:50.211540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:50.212436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:50.213213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 198/400] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:50.213856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdfe7a-4b73-435b-b2f2-77acf4d84df6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.269577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22a86-4fe6-44ee-bb97-e909a25462f7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:50.299196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:50.309857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae292-28e1-4a0e-85a0-f155910056cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.310710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae292-28e1-4a0e-85a0-f155910056cf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.311239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae292-28e1-4a0e-85a0-f155910056cf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.311511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae292-28e1-4a0e-85a0-f155910056cf None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.312726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dae292-28e1-4a0e-85a0-f155910056cf None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:50.314164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dae292-28e1-4a0e-85a0-f155910056cf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:50.315827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 203/401] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:50 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:50.322195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb517e0-0c24-42ac-92d4-e15ab9892393 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.322492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb517e0-0c24-42ac-92d4-e15ab9892393 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.322771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb517e0-0c24-42ac-92d4-e15ab9892393 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.324121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 204/402] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:50.324834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acdfe7a-4b73-435b-b2f2-77acf4d84df6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:50.328620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb517e0-0c24-42ac-92d4-e15ab9892393 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.361093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331afc0-827f-4f91-8363-4f8143854307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.361803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331afc0-827f-4f91-8363-4f8143854307 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.362085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331afc0-827f-4f91-8363-4f8143854307 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.362367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331afc0-827f-4f91-8363-4f8143854307 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.363553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331afc0-827f-4f91-8363-4f8143854307 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:50.365568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331afc0-827f-4f91-8363-4f8143854307 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:50.367220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 199/403] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:50 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:50.367952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331afc0-827f-4f91-8363-4f8143854307 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.421849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:50.448172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb517e0-0c24-42ac-92d4-e15ab9892393 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:50.483395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331afc0-827f-4f91-8363-4f8143854307 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:50.498597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785aaefd-f8b0-449e-b70a-2b9977438993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.500314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaefd-f8b0-449e-b70a-2b9977438993 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.500980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaefd-f8b0-449e-b70a-2b9977438993 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.501628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785aaefd-f8b0-449e-b70a-2b9977438993 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.503071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785aaefd-f8b0-449e-b70a-2b9977438993 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:50.503761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785aaefd-f8b0-449e-b70a-2b9977438993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:50.506321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785aaefd-f8b0-449e-b70a-2b9977438993 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:50.517820 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 205/404] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:50.519253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8d6ca-3185-4f0b-96db-3f0750e5c799 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.519543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8d6ca-3185-4f0b-96db-3f0750e5c799 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.519822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8d6ca-3185-4f0b-96db-3f0750e5c799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.524986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826d3d2-df87-4bce-a4d2-46a727117df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.525678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826d3d2-df87-4bce-a4d2-46a727117df7 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.525952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826d3d2-df87-4bce-a4d2-46a727117df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.526225 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826d3d2-df87-4bce-a4d2-46a727117df7 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6/groups/5b7470692e1a4f61b34f70a3c62de297/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.528213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826d3d2-df87-4bce-a4d2-46a727117df7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2306424887947e5938736c5bbfeabb6, group_id=5b7470692e1a4f61b34f70a3c62de297, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:50.529650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826d3d2-df87-4bce-a4d2-46a727117df7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:50.542780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6ea8d6ca-3185-4f0b-96db-3f0750e5c799 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:50.543096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 200/405] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 21:26:50 2022] PUT /identity/v3/projects/b2306424887947e5938736c5bbfeabb6/groups/5b7470692e1a4f61b34f70a3c62de297/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:50.543880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826d3d2-df87-4bce-a4d2-46a727117df7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.544612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6ea8d6ca-3185-4f0b-96db-3f0750e5c799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:50.556766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:50.648947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 206/406] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:50.650276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8d6ca-3185-4f0b-96db-3f0750e5c799 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.700929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826d3d2-df87-4bce-a4d2-46a727117df7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:50.748233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:50.751988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec082b-a573-47e6-9e19-844bed04f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.752788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec082b-a573-47e6-9e19-844bed04f8ea None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.753688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec082b-a573-47e6-9e19-844bed04f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.753688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec082b-a573-47e6-9e19-844bed04f8ea None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c/groups/5b7470692e1a4f61b34f70a3c62de297/roles/67ac8da7e16f46b496e98633276e6909` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.757938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec082b-a573-47e6-9e19-844bed04f8ea None admin] RBAC: Authorizing `identity:create_grant(project_id=729d3dec279d497d9feb72ae57cadd8c, group_id=5b7470692e1a4f61b34f70a3c62de297, role_id=67ac8da7e16f46b496e98633276e6909)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:50.759384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec082b-a573-47e6-9e19-844bed04f8ea None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:50.781546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8d6ca-3185-4f0b-96db-3f0750e5c799 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:50.781750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 201/407] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 21:26:50 2022] PUT /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c/groups/5b7470692e1a4f61b34f70a3c62de297/roles/67ac8da7e16f46b496e98633276e6909 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:50.782456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec082b-a573-47e6-9e19-844bed04f8ea None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.889957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d7c2d-d8ee-4dd8-9a8a-e90d92c16227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.890670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d7c2d-d8ee-4dd8-9a8a-e90d92c16227 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:50.890780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:50.890947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d7c2d-d8ee-4dd8-9a8a-e90d92c16227 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:50.891220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d7c2d-d8ee-4dd8-9a8a-e90d92c16227 None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:50.897292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d7c2d-d8ee-4dd8-9a8a-e90d92c16227 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:50.898812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d7c2d-d8ee-4dd8-9a8a-e90d92c16227 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:50.900619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 207/408] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:50 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:50.909188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d7c2d-d8ee-4dd8-9a8a-e90d92c16227 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:50.931714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec082b-a573-47e6-9e19-844bed04f8ea None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:50.999186 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c24f7-2381-4fc6-a990-693ef9f34558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:50.999767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c24f7-2381-4fc6-a990-693ef9f34558 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.000059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c24f7-2381-4fc6-a990-693ef9f34558 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.000364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c24f7-2381-4fc6-a990-693ef9f34558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.012157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5c24f7-2381-4fc6-a990-693ef9f34558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-0b5c24f7-2381-4fc6-a990-693ef9f34558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:51.017718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:51.018549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:51.019327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:51.022938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 202/409] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:51.025593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c24f7-2381-4fc6-a990-693ef9f34558 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:51.066018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d7c2d-d8ee-4dd8-9a8a-e90d92c16227 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:51.111619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e458b52-c247-4876-98a8-a937420711b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:51.112926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e458b52-c247-4876-98a8-a937420711b3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.113693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e458b52-c247-4876-98a8-a937420711b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.114152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e458b52-c247-4876-98a8-a937420711b3 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.115725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e458b52-c247-4876-98a8-a937420711b3 None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:51.117683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e458b52-c247-4876-98a8-a937420711b3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:51.119536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 208/410] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:50 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:51.125039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e458b52-c247-4876-98a8-a937420711b3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:51.142926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:51.143113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c24f7-2381-4fc6-a990-693ef9f34558 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:51.187296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:51.212523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b8da-21c5-4953-a5e5-f3b2370215b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:51.213152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b8da-21c5-4953-a5e5-f3b2370215b6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.213498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b8da-21c5-4953-a5e5-f3b2370215b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.213779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9b8da-21c5-4953-a5e5-f3b2370215b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.214503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b8da-21c5-4953-a5e5-f3b2370215b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:51.215941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b8da-21c5-4953-a5e5-f3b2370215b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:51.217357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c9b8da-21c5-4953-a5e5-f3b2370215b6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:51.236273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 203/411] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:51.258398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b8da-21c5-4953-a5e5-f3b2370215b6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:51.314056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e458b52-c247-4876-98a8-a937420711b3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:51.360493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df9d39-106a-4973-adda-7792448820d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:51.361188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df9d39-106a-4973-adda-7792448820d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.361477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df9d39-106a-4973-adda-7792448820d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.361760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08df9d39-106a-4973-adda-7792448820d3 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6/groups/5b7470692e1a4f61b34f70a3c62de297/roles/67ac8da7e16f46b496e98633276e6909` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.366185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df9d39-106a-4973-adda-7792448820d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b2306424887947e5938736c5bbfeabb6, group_id=5b7470692e1a4f61b34f70a3c62de297, role_id=67ac8da7e16f46b496e98633276e6909)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:51.367637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08df9d39-106a-4973-adda-7792448820d3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:51.400641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 209/412] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 21:26:51 2022] PUT /identity/v3/projects/b2306424887947e5938736c5bbfeabb6/groups/5b7470692e1a4f61b34f70a3c62de297/roles/67ac8da7e16f46b496e98633276e6909 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:51.469575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9b8da-21c5-4953-a5e5-f3b2370215b6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:51.520740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f33fb-93b4-4477-a784-5a14046c3e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:51.521462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f33fb-93b4-4477-a784-5a14046c3e8c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.521748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f33fb-93b4-4477-a784-5a14046c3e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.522025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f33fb-93b4-4477-a784-5a14046c3e8c None admin] PATH_INFO: `/v3/groups/8fd3922f45ec4ecd9bc14ea25b960bbd` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.523330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f33fb-93b4-4477-a784-5a14046c3e8c None admin] RBAC: Authorizing `identity:get_group(group_id=8fd3922f45ec4ecd9bc14ea25b960bbd)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:51.524840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f33fb-93b4-4477-a784-5a14046c3e8c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:51.526805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 204/413] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:51 2022] GET /identity/v3/groups/8fd3922f45ec4ecd9bc14ea25b960bbd => generated 229 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:51.532337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df9d39-106a-4973-adda-7792448820d3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:51.636822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:51.663618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0fd3-1294-4de3-bcbc-729ad3699dea None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.663919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0fd3-1294-4de3-bcbc-729ad3699dea None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.664216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed0fd3-1294-4de3-bcbc-729ad3699dea None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.665576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 205/414] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:51.671043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732220b-511f-43f7-baba-dc68aa5dcdec None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.671332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732220b-511f-43f7-baba-dc68aa5dcdec None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.671612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732220b-511f-43f7-baba-dc68aa5dcdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.679127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08df9d39-106a-4973-adda-7792448820d3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:51.699176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f732220b-511f-43f7-baba-dc68aa5dcdec None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:51.700441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f732220b-511f-43f7-baba-dc68aa5dcdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:51.718410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b083c85-7146-4685-a3e0-72340b760090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:51.719060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b083c85-7146-4685-a3e0-72340b760090 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.719529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b083c85-7146-4685-a3e0-72340b760090 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.719815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b083c85-7146-4685-a3e0-72340b760090 None admin] PATH_INFO: `/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.721386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b083c85-7146-4685-a3e0-72340b760090 None admin] RBAC: Authorizing `identity:get_project(project_id=4a739ee2f7d746e0a37b1f7b651a505d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:51.722843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b083c85-7146-4685-a3e0-72340b760090 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:51.725332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 210/415] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:51 2022] GET /identity/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:51.730596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b083c85-7146-4685-a3e0-72340b760090 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:51.787602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:51.796867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 206/416] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:51.835337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732220b-511f-43f7-baba-dc68aa5dcdec None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:51.924169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b083c85-7146-4685-a3e0-72340b760090 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:51.983317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c91edd-8d3e-4cf8-b60e-68a1bc740ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:51.983993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91edd-8d3e-4cf8-b60e-68a1bc740ae2 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.984302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91edd-8d3e-4cf8-b60e-68a1bc740ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.984579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c91edd-8d3e-4cf8-b60e-68a1bc740ae2 None admin] PATH_INFO: `/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d/groups/8fd3922f45ec4ecd9bc14ea25b960bbd/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.987686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c91edd-8d3e-4cf8-b60e-68a1bc740ae2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a739ee2f7d746e0a37b1f7b651a505d, group_id=8fd3922f45ec4ecd9bc14ea25b960bbd, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:51.989166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c91edd-8d3e-4cf8-b60e-68a1bc740ae2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:51.993813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732220b-511f-43f7-baba-dc68aa5dcdec None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:51.996453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.020610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 211/417] 10.222.0.57 () {58 vars in 1442 bytes} [Tue Aug 2 21:26:51 2022] PUT /identity/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d/groups/8fd3922f45ec4ecd9bc14ea25b960bbd/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:26:52.049309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58a5a6-0012-44c2-870f-43ed666bdc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.049876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58a5a6-0012-44c2-870f-43ed666bdc6d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.050164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58a5a6-0012-44c2-870f-43ed666bdc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.050424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58a5a6-0012-44c2-870f-43ed666bdc6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.074216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58a5a6-0012-44c2-870f-43ed666bdc6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9e58a5a6-0012-44c2-870f-43ed666bdc6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:52.079404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:52.080421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:52.081187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:52.084252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 207/418] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:52.086685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c91edd-8d3e-4cf8-b60e-68a1bc740ae2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.250895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c91edd-8d3e-4cf8-b60e-68a1bc740ae2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.290226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f490e3-1f96-4c2f-8dbe-d68caf3ef4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.290897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f490e3-1f96-4c2f-8dbe-d68caf3ef4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.291180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f490e3-1f96-4c2f-8dbe-d68caf3ef4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.291505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f490e3-1f96-4c2f-8dbe-d68caf3ef4f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.292279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f490e3-1f96-4c2f-8dbe-d68caf3ef4f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:52.292589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f490e3-1f96-4c2f-8dbe-d68caf3ef4f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.293978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f490e3-1f96-4c2f-8dbe-d68caf3ef4f6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.303267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 212/419] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:52.313249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58a5a6-0012-44c2-870f-43ed666bdc6d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.363811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.430603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58a5a6-0012-44c2-870f-43ed666bdc6d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.476154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051013-8236-4c09-a7a1-fb625f134d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.476878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051013-8236-4c09-a7a1-fb625f134d75 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.477129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051013-8236-4c09-a7a1-fb625f134d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.477319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb051013-8236-4c09-a7a1-fb625f134d75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.567858 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb051013-8236-4c09-a7a1-fb625f134d75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.569167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb051013-8236-4c09-a7a1-fb625f134d75 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.614257 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.671977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 208/420] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:52.677265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f490e3-1f96-4c2f-8dbe-d68caf3ef4f6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.777674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.828068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f490e3-1f96-4c2f-8dbe-d68caf3ef4f6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.863682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158ed97-90b8-4618-8a2b-59eef2e53771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.864361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ed97-90b8-4618-8a2b-59eef2e53771 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.864681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ed97-90b8-4618-8a2b-59eef2e53771 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.864963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158ed97-90b8-4618-8a2b-59eef2e53771 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.866148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158ed97-90b8-4618-8a2b-59eef2e53771 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.867593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158ed97-90b8-4618-8a2b-59eef2e53771 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.869463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 213/421] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:52.874875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051013-8236-4c09-a7a1-fb625f134d75 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.941415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ed207-1f89-4f57-958a-9c0f19c45c37 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.941715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ed207-1f89-4f57-958a-9c0f19c45c37 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.941972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ed207-1f89-4f57-958a-9c0f19c45c37 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.943959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 214/422] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:52.949140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c58ba-e06b-41ff-a554-c05b2fa5cb93 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.949656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c58ba-e06b-41ff-a554-c05b2fa5cb93 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.950127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c58ba-e06b-41ff-a554-c05b2fa5cb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.969399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6a1c58ba-e06b-41ff-a554-c05b2fa5cb93 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:52.970752 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6a1c58ba-e06b-41ff-a554-c05b2fa5cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:53.012968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb051013-8236-4c09-a7a1-fb625f134d75 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:53.070808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f14e3-04f0-459d-b74e-159c64ade2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:53.071475 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f14e3-04f0-459d-b74e-159c64ade2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:53.071753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f14e3-04f0-459d-b74e-159c64ade2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:53.072023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f14e3-04f0-459d-b74e-159c64ade2f7 None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:53.073366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f14e3-04f0-459d-b74e-159c64ade2f7 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:53.075025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f14e3-04f0-459d-b74e-159c64ade2f7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:53.077414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 209/423] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:53.083012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f14e3-04f0-459d-b74e-159c64ade2f7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:53.088794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 215/424] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 02 21:26:53.111744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c58ba-e06b-41ff-a554-c05b2fa5cb93 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:53.122927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:53.171061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:53.193415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f14e3-04f0-459d-b74e-159c64ade2f7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:53.228013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688bebd-6cd7-483e-9b46-d83124d339be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:53.228672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688bebd-6cd7-483e-9b46-d83124d339be None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:53.228955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688bebd-6cd7-483e-9b46-d83124d339be None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:53.229232 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9688bebd-6cd7-483e-9b46-d83124d339be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:53.230143 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688bebd-6cd7-483e-9b46-d83124d339be None admin] RBAC: Adding query filter params (group.id=5b7470692e1a4f61b34f70a3c62de297, role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=729d3dec279d497d9feb72ae57cadd8c) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:53.230457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688bebd-6cd7-483e-9b46-d83124d339be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:53.231886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9688bebd-6cd7-483e-9b46-d83124d339be None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:53.233113 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c58ba-e06b-41ff-a554-c05b2fa5cb93 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:53.244285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 210/425] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:53 2022] GET /identity/v3/role_assignments?group.id=5b7470692e1a4f61b34f70a3c62de297&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:53.272824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853d835-d7cc-4bc0-a443-34bb8885d85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:53.273739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853d835-d7cc-4bc0-a443-34bb8885d85a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:53.274187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853d835-d7cc-4bc0-a443-34bb8885d85a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:53.274595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853d835-d7cc-4bc0-a443-34bb8885d85a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:53.287345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853d835-d7cc-4bc0-a443-34bb8885d85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b853d835-d7cc-4bc0-a443-34bb8885d85a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:53.292861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:53.293971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:26:53.294915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:53.297395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 216/426] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:53.304540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688bebd-6cd7-483e-9b46-d83124d339be None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:53.388250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:53.425975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9688bebd-6cd7-483e-9b46-d83124d339be None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:53.462834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97913a-72e8-4af7-a5a2-b6892ea59f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:53.463516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97913a-72e8-4af7-a5a2-b6892ea59f87 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:53.463930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97913a-72e8-4af7-a5a2-b6892ea59f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:53.466850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97913a-72e8-4af7-a5a2-b6892ea59f87 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:53.468763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97913a-72e8-4af7-a5a2-b6892ea59f87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:53.469079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97913a-72e8-4af7-a5a2-b6892ea59f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:53.470515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97913a-72e8-4af7-a5a2-b6892ea59f87 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:53.480702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92f0b-24a2-4b20-810c-f0de399e80fc None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:53.481184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92f0b-24a2-4b20-810c-f0de399e80fc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:53.481456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede92f0b-24a2-4b20-810c-f0de399e80fc None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:53.482810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 217/427] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:53.488115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30cd93-155e-4b78-8931-a9caba465488 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:53.488451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30cd93-155e-4b78-8931-a9caba465488 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:53.488723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30cd93-155e-4b78-8931-a9caba465488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:53.492224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 211/428] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:26:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:53.493272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97913a-72e8-4af7-a5a2-b6892ea59f87 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:53.514775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ec30cd93-155e-4b78-8931-a9caba465488 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:53.516066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ec30cd93-155e-4b78-8931-a9caba465488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:53.610866 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 218/429] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:53.628456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97913a-72e8-4af7-a5a2-b6892ea59f87 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:53.637247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30cd93-155e-4b78-8931-a9caba465488 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:53.673881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010646c-97d8-4c77-b238-cabd8e49afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:53.675099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010646c-97d8-4c77-b238-cabd8e49afe0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:53.675099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010646c-97d8-4c77-b238-cabd8e49afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:53.675099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5010646c-97d8-4c77-b238-cabd8e49afe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:53.687826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:53.698226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:53.774876 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30cd93-155e-4b78-8931-a9caba465488 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:53.778278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010646c-97d8-4c77-b238-cabd8e49afe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:53.779934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5010646c-97d8-4c77-b238-cabd8e49afe0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:53.830525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b10705-f2a1-4508-b86e-f719c9fed0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:53.831789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b10705-f2a1-4508-b86e-f719c9fed0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:53.832360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b10705-f2a1-4508-b86e-f719c9fed0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:53.834195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b10705-f2a1-4508-b86e-f719c9fed0e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:53.848749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b10705-f2a1-4508-b86e-f719c9fed0e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-38b10705-f2a1-4508-b86e-f719c9fed0e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:53.856964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:53.857905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:53.858662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:53.861708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 219/430] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:53.871481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b10705-f2a1-4508-b86e-f719c9fed0e9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:53.914815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 212/431] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:53.920540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010646c-97d8-4c77-b238-cabd8e49afe0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:53.963841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:53.981073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b10705-f2a1-4508-b86e-f719c9fed0e9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:53.988795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:54.032463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87482ef-33f8-419b-8efd-b1eda4fc842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.033233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87482ef-33f8-419b-8efd-b1eda4fc842a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.033636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87482ef-33f8-419b-8efd-b1eda4fc842a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.033914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87482ef-33f8-419b-8efd-b1eda4fc842a None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.034912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87482ef-33f8-419b-8efd-b1eda4fc842a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:54.035641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87482ef-33f8-419b-8efd-b1eda4fc842a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:54.038164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87482ef-33f8-419b-8efd-b1eda4fc842a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:54.044561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5010646c-97d8-4c77-b238-cabd8e49afe0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:54.049789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 220/432] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:54.058214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87482ef-33f8-419b-8efd-b1eda4fc842a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:54.097174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8750b7-2007-46c5-bbb4-bf6f03abaa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.098072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8750b7-2007-46c5-bbb4-bf6f03abaa39 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.098499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8750b7-2007-46c5-bbb4-bf6f03abaa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.099481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8750b7-2007-46c5-bbb4-bf6f03abaa39 None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.100880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8750b7-2007-46c5-bbb4-bf6f03abaa39 None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:54.102459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8750b7-2007-46c5-bbb4-bf6f03abaa39 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:54.104611 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 213/433] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:53 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:54.111654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8750b7-2007-46c5-bbb4-bf6f03abaa39 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:54.199069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87482ef-33f8-419b-8efd-b1eda4fc842a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:54.234921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ea48a-f009-49f6-b13b-4b4f169359c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.235508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea48a-f009-49f6-b13b-4b4f169359c1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.235727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea48a-f009-49f6-b13b-4b4f169359c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.236003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea48a-f009-49f6-b13b-4b4f169359c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.246352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8750b7-2007-46c5-bbb4-bf6f03abaa39 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:54.254315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:54.272509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:54.283684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d72cf10-7b43-46b9-9ced-467fe532fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.284573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72cf10-7b43-46b9-9ced-467fe532fb48 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.284852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72cf10-7b43-46b9-9ced-467fe532fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.285202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d72cf10-7b43-46b9-9ced-467fe532fb48 None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.286766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72cf10-7b43-46b9-9ced-467fe532fb48 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:54.288249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d72cf10-7b43-46b9-9ced-467fe532fb48 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:54.289818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 214/434] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:54.295629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b78e4-9c3a-4d8f-b380-3e76ca2f97fe None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.295916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b78e4-9c3a-4d8f-b380-3e76ca2f97fe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.296221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b78e4-9c3a-4d8f-b380-3e76ca2f97fe None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.297423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 215/435] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:54.298104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b78e4-9c3a-4d8f-b380-3e76ca2f97fe None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:54.315338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea48a-f009-49f6-b13b-4b4f169359c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:54.317117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea48a-f009-49f6-b13b-4b4f169359c1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:54.408680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b78e4-9c3a-4d8f-b380-3e76ca2f97fe None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:54.424000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 221/436] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:54.425267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d727c-5848-4ac8-b04c-949e75d91185 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.425817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d727c-5848-4ac8-b04c-949e75d91185 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.426091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d727c-5848-4ac8-b04c-949e75d91185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.444757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-092d727c-5848-4ac8-b04c-949e75d91185 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:54.445935 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-092d727c-5848-4ac8-b04c-949e75d91185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:54.451803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c37513-6c7a-46e1-93e9-38ddc8f22da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.452464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c37513-6c7a-46e1-93e9-38ddc8f22da0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.452747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c37513-6c7a-46e1-93e9-38ddc8f22da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.453027 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c37513-6c7a-46e1-93e9-38ddc8f22da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.454223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c37513-6c7a-46e1-93e9-38ddc8f22da0 None admin] RBAC: Adding query filter params (group.id=5b7470692e1a4f61b34f70a3c62de297, role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee, scope.project.id=b2306424887947e5938736c5bbfeabb6) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:54.454535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c37513-6c7a-46e1-93e9-38ddc8f22da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:54.456383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c37513-6c7a-46e1-93e9-38ddc8f22da0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:54.463122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 216/437] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/role_assignments?group.id=5b7470692e1a4f61b34f70a3c62de297&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:54.463812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c37513-6c7a-46e1-93e9-38ddc8f22da0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:54.513293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:54.557167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:54.565316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 222/438] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:54.588428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d727c-5848-4ac8-b04c-949e75d91185 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:54.597971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c37513-6c7a-46e1-93e9-38ddc8f22da0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:54.637427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2c1a0-7baa-484a-9630-ec14126706d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.638065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c1a0-7baa-484a-9630-ec14126706d4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.638345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c1a0-7baa-484a-9630-ec14126706d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.638624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2c1a0-7baa-484a-9630-ec14126706d4 None admin] PATH_INFO: `/v3/projects/729d3dec279d497d9feb72ae57cadd8c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.639803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c1a0-7baa-484a-9630-ec14126706d4 None admin] RBAC: Authorizing `identity:get_project(project_id=729d3dec279d497d9feb72ae57cadd8c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:54.641986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2c1a0-7baa-484a-9630-ec14126706d4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:54.643711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 217/439] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/projects/729d3dec279d497d9feb72ae57cadd8c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:54.644157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c05e60-12e1-4e6e-958d-3a152fac8737 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.644376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c05e60-12e1-4e6e-958d-3a152fac8737 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.644651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c05e60-12e1-4e6e-958d-3a152fac8737 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.646393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 218/440] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:54.651118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c05e60-12e1-4e6e-958d-3a152fac8737 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:54.704603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d727c-5848-4ac8-b04c-949e75d91185 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:54.737967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee8ff22-d8fe-44b6-9cb2-a6e500b5d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.738603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8ff22-d8fe-44b6-9cb2-a6e500b5d83b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.738881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8ff22-d8fe-44b6-9cb2-a6e500b5d83b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.739162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee8ff22-d8fe-44b6-9cb2-a6e500b5d83b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.749252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee8ff22-d8fe-44b6-9cb2-a6e500b5d83b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-cee8ff22-d8fe-44b6-9cb2-a6e500b5d83b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:54.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:54.755204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:26:54.756200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 223/441] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:54.757003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447875ab-d6d8-4f91-bcac-d6a9530249c4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.757003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447875ab-d6d8-4f91-bcac-d6a9530249c4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.757140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447875ab-d6d8-4f91-bcac-d6a9530249c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.761023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c05e60-12e1-4e6e-958d-3a152fac8737 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:54.768022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:54.775201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-447875ab-d6d8-4f91-bcac-d6a9530249c4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:54.776421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-447875ab-d6d8-4f91-bcac-d6a9530249c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:54.795872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba07f14-dbe5-49fa-a3f5-1897eda57862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.796560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba07f14-dbe5-49fa-a3f5-1897eda57862 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.796848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba07f14-dbe5-49fa-a3f5-1897eda57862 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.797124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba07f14-dbe5-49fa-a3f5-1897eda57862 None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.798292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba07f14-dbe5-49fa-a3f5-1897eda57862 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:54.799720 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba07f14-dbe5-49fa-a3f5-1897eda57862 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:54.801338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 219/442] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:54.802132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba07f14-dbe5-49fa-a3f5-1897eda57862 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:54.831526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:54.845863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 224/443] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:54.847193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447875ab-d6d8-4f91-bcac-d6a9530249c4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:54.906079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba07f14-dbe5-49fa-a3f5-1897eda57862 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:54.938670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64300fa9-c31f-413a-960c-2abdba46720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.939284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64300fa9-c31f-413a-960c-2abdba46720c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.939564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64300fa9-c31f-413a-960c-2abdba46720c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.939838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64300fa9-c31f-413a-960c-2abdba46720c None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.940583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64300fa9-c31f-413a-960c-2abdba46720c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:54.940888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64300fa9-c31f-413a-960c-2abdba46720c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:54.942238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64300fa9-c31f-413a-960c-2abdba46720c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:54.949077 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447875ab-d6d8-4f91-bcac-d6a9530249c4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:54.950704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 220/444] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:54.951527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64300fa9-c31f-413a-960c-2abdba46720c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:54.986326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:54.987693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba99ae4-9975-4e64-9601-05f4dbdd3d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:54.988534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba99ae4-9975-4e64-9601-05f4dbdd3d72 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:54.988823 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba99ae4-9975-4e64-9601-05f4dbdd3d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:54.989098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba99ae4-9975-4e64-9601-05f4dbdd3d72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:54.989890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba99ae4-9975-4e64-9601-05f4dbdd3d72 None admin] RBAC: Adding query filter params (group.id=5b7470692e1a4f61b34f70a3c62de297, role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=729d3dec279d497d9feb72ae57cadd8c) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:54.990199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba99ae4-9975-4e64-9601-05f4dbdd3d72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:54.991629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba99ae4-9975-4e64-9601-05f4dbdd3d72 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:54.997291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 225/445] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/role_assignments?group.id=5b7470692e1a4f61b34f70a3c62de297&scope.project.id=729d3dec279d497d9feb72ae57cadd8c&role.id=67ac8da7e16f46b496e98633276e6909 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:54.998060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba99ae4-9975-4e64-9601-05f4dbdd3d72 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.056182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64300fa9-c31f-413a-960c-2abdba46720c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.066264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.095981 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c7f55-8e28-4e79-bd6e-a2b9061b4ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.096745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7f55-8e28-4e79-bd6e-a2b9061b4ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.097033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7f55-8e28-4e79-bd6e-a2b9061b4ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.097312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c7f55-8e28-4e79-bd6e-a2b9061b4ee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.110044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c7f55-8e28-4e79-bd6e-a2b9061b4ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ab4c7f55-8e28-4e79-bd6e-a2b9061b4ee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:55.115788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:55.116794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:55.117548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 221/446] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:55.122964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c7f55-8e28-4e79-bd6e-a2b9061b4ee3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.125351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba99ae4-9975-4e64-9601-05f4dbdd3d72 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.165491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261deba0-ebb5-4327-b241-da27a3774e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.165491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261deba0-ebb5-4327-b241-da27a3774e3c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.165886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261deba0-ebb5-4327-b241-da27a3774e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.166064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261deba0-ebb5-4327-b241-da27a3774e3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.236310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.242230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261deba0-ebb5-4327-b241-da27a3774e3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.243633 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c7f55-8e28-4e79-bd6e-a2b9061b4ee3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.243745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261deba0-ebb5-4327-b241-da27a3774e3c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.283068 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039dbdb-b92b-4b8c-a72a-5f1a5eb75a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.284447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039dbdb-b92b-4b8c-a72a-5f1a5eb75a1f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.284943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039dbdb-b92b-4b8c-a72a-5f1a5eb75a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.285705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039dbdb-b92b-4b8c-a72a-5f1a5eb75a1f None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.286093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039dbdb-b92b-4b8c-a72a-5f1a5eb75a1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:55.286443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039dbdb-b92b-4b8c-a72a-5f1a5eb75a1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.288664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039dbdb-b92b-4b8c-a72a-5f1a5eb75a1f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.300075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 222/447] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:55.306273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039dbdb-b92b-4b8c-a72a-5f1a5eb75a1f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.307458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.361909 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 226/448] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:26:55.368036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261deba0-ebb5-4327-b241-da27a3774e3c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.422856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039dbdb-b92b-4b8c-a72a-5f1a5eb75a1f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.467001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5faa9-7546-4156-bbe6-3bd41116a4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.467633 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5faa9-7546-4156-bbe6-3bd41116a4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.467916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5faa9-7546-4156-bbe6-3bd41116a4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.468240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5faa9-7546-4156-bbe6-3bd41116a4f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.482105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261deba0-ebb5-4327-b241-da27a3774e3c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.498669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.526659 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3d7b8-25c8-44a1-b322-a39b8dcf88fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.527311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3d7b8-25c8-44a1-b322-a39b8dcf88fd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.527749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3d7b8-25c8-44a1-b322-a39b8dcf88fd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.528022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3d7b8-25c8-44a1-b322-a39b8dcf88fd None admin] PATH_INFO: `/v3/projects/b2306424887947e5938736c5bbfeabb6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.529226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3d7b8-25c8-44a1-b322-a39b8dcf88fd None admin] RBAC: Authorizing `identity:get_project(project_id=b2306424887947e5938736c5bbfeabb6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.530923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3d7b8-25c8-44a1-b322-a39b8dcf88fd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.532618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 227/449] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/projects/b2306424887947e5938736c5bbfeabb6 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:55.538037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3d7b8-25c8-44a1-b322-a39b8dcf88fd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.541733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5faa9-7546-4156-bbe6-3bd41116a4f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.543183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5faa9-7546-4156-bbe6-3bd41116a4f4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.559228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.634726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3d7b8-25c8-44a1-b322-a39b8dcf88fd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.640055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 223/450] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 21:26:55.645596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5faa9-7546-4156-bbe6-3bd41116a4f4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.668886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde8064-0992-4902-9f2b-a50a6ba5812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.669711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8064-0992-4902-9f2b-a50a6ba5812e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.669994 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8064-0992-4902-9f2b-a50a6ba5812e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.670272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bde8064-0992-4902-9f2b-a50a6ba5812e None admin] PATH_INFO: `/v3/groups/5b7470692e1a4f61b34f70a3c62de297` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.671456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde8064-0992-4902-9f2b-a50a6ba5812e None admin] RBAC: Authorizing `identity:get_group(group_id=5b7470692e1a4f61b34f70a3c62de297)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.672937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bde8064-0992-4902-9f2b-a50a6ba5812e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.674522 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 228/451] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/groups/5b7470692e1a4f61b34f70a3c62de297 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:55.680719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde8064-0992-4902-9f2b-a50a6ba5812e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.701332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.742445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5faa9-7546-4156-bbe6-3bd41116a4f4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.765808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.776050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b8da2-bd64-4e05-a101-9931f512a8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.776712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b8da2-bd64-4e05-a101-9931f512a8ec None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.776990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b8da2-bd64-4e05-a101-9931f512a8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.777259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b8da2-bd64-4e05-a101-9931f512a8ec None admin] PATH_INFO: `/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.777684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bde8064-0992-4902-9f2b-a50a6ba5812e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.778398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b8da2-bd64-4e05-a101-9931f512a8ec None admin] RBAC: Authorizing `identity:get_project(project_id=4a739ee2f7d746e0a37b1f7b651a505d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.779814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b8da2-bd64-4e05-a101-9931f512a8ec None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.781715 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 224/452] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/projects/4a739ee2f7d746e0a37b1f7b651a505d => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:55.787516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b8da2-bd64-4e05-a101-9931f512a8ec None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.812713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362c3d4-8b92-47ae-8490-c04421441580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.813256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362c3d4-8b92-47ae-8490-c04421441580 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.813530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362c3d4-8b92-47ae-8490-c04421441580 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.813796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362c3d4-8b92-47ae-8490-c04421441580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.814576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362c3d4-8b92-47ae-8490-c04421441580 None admin] RBAC: Adding query filter params (group.id=5b7470692e1a4f61b34f70a3c62de297, role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=b2306424887947e5938736c5bbfeabb6) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:55.814881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362c3d4-8b92-47ae-8490-c04421441580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.816328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7362c3d4-8b92-47ae-8490-c04421441580 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.821850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 229/453] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/role_assignments?group.id=5b7470692e1a4f61b34f70a3c62de297&scope.project.id=b2306424887947e5938736c5bbfeabb6&role.id=67ac8da7e16f46b496e98633276e6909 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:55.890674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b8da2-bd64-4e05-a101-9931f512a8ec None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.918264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.927870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a568572-e929-4e3f-a24c-d82bf17a8743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.928636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a568572-e929-4e3f-a24c-d82bf17a8743 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.928919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a568572-e929-4e3f-a24c-d82bf17a8743 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.929190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a568572-e929-4e3f-a24c-d82bf17a8743 None admin] PATH_INFO: `/v3/groups/8fd3922f45ec4ecd9bc14ea25b960bbd` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.930409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a568572-e929-4e3f-a24c-d82bf17a8743 None admin] RBAC: Authorizing `identity:get_group(group_id=8fd3922f45ec4ecd9bc14ea25b960bbd)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.931874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a568572-e929-4e3f-a24c-d82bf17a8743 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.933555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 225/454] 10.222.0.57 () {56 vars in 1180 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/groups/8fd3922f45ec4ecd9bc14ea25b960bbd => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:55.939622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362c3d4-8b92-47ae-8490-c04421441580 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:56.041526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362c3d4-8b92-47ae-8490-c04421441580 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:56.073687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0070f9-42ed-46eb-95c8-e58b899829df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:56.074239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0070f9-42ed-46eb-95c8-e58b899829df None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.074521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0070f9-42ed-46eb-95c8-e58b899829df None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.074799 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0070f9-42ed-46eb-95c8-e58b899829df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.075595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0070f9-42ed-46eb-95c8-e58b899829df None admin] RBAC: Adding query filter params (group.id=8fd3922f45ec4ecd9bc14ea25b960bbd, role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=4a739ee2f7d746e0a37b1f7b651a505d) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:56.075903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0070f9-42ed-46eb-95c8-e58b899829df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:56.077374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0070f9-42ed-46eb-95c8-e58b899829df None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:56.083707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 230/455] 10.222.0.57 () {56 vars in 1376 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/role_assignments?group.id=8fd3922f45ec4ecd9bc14ea25b960bbd&scope.project.id=4a739ee2f7d746e0a37b1f7b651a505d&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:58.662045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96017537-a1c7-431b-b7be-70513e304643 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:58.662591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96017537-a1c7-431b-b7be-70513e304643 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:58.662591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96017537-a1c7-431b-b7be-70513e304643 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:58.664208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 226/456] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:58.669174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef44c16-45e9-4b34-a993-8574de91ffd8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:58.669967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef44c16-45e9-4b34-a993-8574de91ffd8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:58.670438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef44c16-45e9-4b34-a993-8574de91ffd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:58.697117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6ef44c16-45e9-4b34-a993-8574de91ffd8 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:58.698646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6ef44c16-45e9-4b34-a993-8574de91ffd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:58.710767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:58.789831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 231/457] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:58.830297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96017537-a1c7-431b-b7be-70513e304643 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:58.866444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e5970-0aef-48b7-a479-2a97f4e0a7bd None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:58.867500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e5970-0aef-48b7-a479-2a97f4e0a7bd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:58.867888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e5970-0aef-48b7-a479-2a97f4e0a7bd None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:58.869983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 232/458] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:58.871460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e876ea-98fd-414d-9394-ff243ceaec23 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:58.871793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e876ea-98fd-414d-9394-ff243ceaec23 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:58.872252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e876ea-98fd-414d-9394-ff243ceaec23 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:58.873870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 233/459] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:58.878636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f53a-b5c7-4705-b0df-5c93d17cb0d5 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:58.878922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f53a-b5c7-4705-b0df-5c93d17cb0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:58.879229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f53a-b5c7-4705-b0df-5c93d17cb0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:58.903449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4262f53a-b5c7-4705-b0df-5c93d17cb0d5 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:58.906020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4262f53a-b5c7-4705-b0df-5c93d17cb0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:58.963358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96017537-a1c7-431b-b7be-70513e304643 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:58.995161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 234/460] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:58.996746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc007f-71e5-4cc2-a0fd-eae76b5a8e5b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:58.997246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc007f-71e5-4cc2-a0fd-eae76b5a8e5b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:58.997746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc007f-71e5-4cc2-a0fd-eae76b5a8e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.017394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-59dc007f-71e5-4cc2-a0fd-eae76b5a8e5b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:59.018889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-59dc007f-71e5-4cc2-a0fd-eae76b5a8e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:59.030179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3f493-f0bb-4598-8836-b9e2ed831646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.030900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3f493-f0bb-4598-8836-b9e2ed831646 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.031188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3f493-f0bb-4598-8836-b9e2ed831646 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.031463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3f493-f0bb-4598-8836-b9e2ed831646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.050442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3f493-f0bb-4598-8836-b9e2ed831646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.053076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3f493-f0bb-4598-8836-b9e2ed831646 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4be3f493-f0bb-4598-8836-b9e2ed831646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:26:59.072708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:59.073569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:59.074361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:26:59.074361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:26:59.074361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:59.074361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:59.076279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 227/461] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:59.077244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3f493-f0bb-4598-8836-b9e2ed831646 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.106521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 235/462] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:59.112260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc007f-71e5-4cc2-a0fd-eae76b5a8e5b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.116189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.139000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.205693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3f493-f0bb-4598-8836-b9e2ed831646 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.220209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc007f-71e5-4cc2-a0fd-eae76b5a8e5b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.240516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2c788-f9b5-492a-b079-6e1f465807cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.241498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2c788-f9b5-492a-b079-6e1f465807cb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.241990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2c788-f9b5-492a-b079-6e1f465807cb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.242445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2c788-f9b5-492a-b079-6e1f465807cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.253573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2c788-f9b5-492a-b079-6e1f465807cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.255962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2c788-f9b5-492a-b079-6e1f465807cb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.262831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc9d74-153e-471f-b9b5-0a40fd212bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.263528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc9d74-153e-471f-b9b5-0a40fd212bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.263818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc9d74-153e-471f-b9b5-0a40fd212bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.264097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedc9d74-153e-471f-b9b5-0a40fd212bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.265441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc9d74-153e-471f-b9b5-0a40fd212bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:59.265441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc9d74-153e-471f-b9b5-0a40fd212bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.266770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedc9d74-153e-471f-b9b5-0a40fd212bc2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-efb2c788-f9b5-492a-b079-6e1f465807cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:26:59.274546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:59.275420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:59.276356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:26:59.276356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:26:59.276356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:59.276356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:59.278218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 228/463] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:59.279196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2c788-f9b5-492a-b079-6e1f465807cb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.281866 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 236/464] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:59.289662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc9d74-153e-471f-b9b5-0a40fd212bc2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.362837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.381050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.385308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2c788-f9b5-492a-b079-6e1f465807cb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.400955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedc9d74-153e-471f-b9b5-0a40fd212bc2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.420941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b643d6-0811-4655-bce3-c09d12b08dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.421576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b643d6-0811-4655-bce3-c09d12b08dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.421853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b643d6-0811-4655-bce3-c09d12b08dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.422120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b643d6-0811-4655-bce3-c09d12b08dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.433337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b643d6-0811-4655-bce3-c09d12b08dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.434749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b643d6-0811-4655-bce3-c09d12b08dd5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.436966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8950e646-3e5a-4784-9d9b-f3a1c149520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.437577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950e646-3e5a-4784-9d9b-f3a1c149520e None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.437860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950e646-3e5a-4784-9d9b-f3a1c149520e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.438135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950e646-3e5a-4784-9d9b-f3a1c149520e None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.438814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950e646-3e5a-4784-9d9b-f3a1c149520e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.440267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8950e646-3e5a-4784-9d9b-f3a1c149520e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f6b643d6-0811-4655-bce3-c09d12b08dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:26:59.449024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:59.449838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:59.450802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:26:59.450802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:26:59.450802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:59.450802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:26:59.450802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 229/465] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:59.456487 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b643d6-0811-4655-bce3-c09d12b08dd5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.464064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 237/466] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:59 2022] POST /identity/v3/users => generated 246 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:59.465585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe827-0ad0-4e61-aacf-e4d58ac51b0e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.466011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe827-0ad0-4e61-aacf-e4d58ac51b0e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.466287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fe827-0ad0-4e61-aacf-e4d58ac51b0e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.467702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 238/467] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:59.474122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fe827-0ad0-4e61-aacf-e4d58ac51b0e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.585304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b643d6-0811-4655-bce3-c09d12b08dd5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.630374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2fe827-0ad0-4e61-aacf-e4d58ac51b0e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.639159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f8ba88-98c9-4632-b928-1bb49d0adbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.639790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ba88-98c9-4632-b928-1bb49d0adbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.640071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ba88-98c9-4632-b928-1bb49d0adbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.640374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f8ba88-98c9-4632-b928-1bb49d0adbc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.641079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8ba88-98c9-4632-b928-1bb49d0adbc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:59.641382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8ba88-98c9-4632-b928-1bb49d0adbc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.643161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f8ba88-98c9-4632-b928-1bb49d0adbc0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.656485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 230/468] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:59.658273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.662728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e862cc4-9eba-4d2d-81ec-44b277c6cbb9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.663332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e862cc4-9eba-4d2d-81ec-44b277c6cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.663332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e862cc4-9eba-4d2d-81ec-44b277c6cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.676241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cfce7-c87c-4f6a-957b-e23980605964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.678033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cfce7-c87c-4f6a-957b-e23980605964 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.678640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cfce7-c87c-4f6a-957b-e23980605964 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.679694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cfce7-c87c-4f6a-957b-e23980605964 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.680654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cfce7-c87c-4f6a-957b-e23980605964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:59.681431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cfce7-c87c-4f6a-957b-e23980605964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.682992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cfce7-c87c-4f6a-957b-e23980605964 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.685079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5e862cc4-9eba-4d2d-81ec-44b277c6cbb9 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:59.686731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5e862cc4-9eba-4d2d-81ec-44b277c6cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:59.690517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.701685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 239/469] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:59.702934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cfce7-c87c-4f6a-957b-e23980605964 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.772323 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 231/470] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:59.773515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e862cc4-9eba-4d2d-81ec-44b277c6cbb9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.837274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cfce7-c87c-4f6a-957b-e23980605964 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.882080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c4841-cb39-405e-80d0-de810bb35891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.882790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c4841-cb39-405e-80d0-de810bb35891 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.883137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c4841-cb39-405e-80d0-de810bb35891 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.883478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c4841-cb39-405e-80d0-de810bb35891 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.884261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c4841-cb39-405e-80d0-de810bb35891 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.886624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c4841-cb39-405e-80d0-de810bb35891 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.897831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e862cc4-9eba-4d2d-81ec-44b277c6cbb9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.917817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 240/471] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:59 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:59.920936 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c4841-cb39-405e-80d0-de810bb35891 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.981817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7ae5f-5275-4cc9-b372-79ba24c93988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.981817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7ae5f-5275-4cc9-b372-79ba24c93988 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.982105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7ae5f-5275-4cc9-b372-79ba24c93988 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.982194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7ae5f-5275-4cc9-b372-79ba24c93988 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.982851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7ae5f-5275-4cc9-b372-79ba24c93988 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.984366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7ae5f-5275-4cc9-b372-79ba24c93988 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.992508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:00.014342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:00.053566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 232/472] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:26:59 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:00.072889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c4841-cb39-405e-80d0-de810bb35891 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:00.115907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370444f-3517-4d19-a2e5-8898eb0a3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:00.116845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370444f-3517-4d19-a2e5-8898eb0a3d29 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:00.117277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370444f-3517-4d19-a2e5-8898eb0a3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:00.117696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370444f-3517-4d19-a2e5-8898eb0a3d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:00.130509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370444f-3517-4d19-a2e5-8898eb0a3d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:00.132384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370444f-3517-4d19-a2e5-8898eb0a3d29 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4370444f-3517-4d19-a2e5-8898eb0a3d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:00.149839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:00.150937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:00.152002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:00.152002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:00.152002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:00.152002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:00.154062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 241/473] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:00.160710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7ae5f-5275-4cc9-b372-79ba24c93988 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:00.225475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fe1b8-ca61-4936-b9e2-17f0fc775583 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:00.226110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fe1b8-ca61-4936-b9e2-17f0fc775583 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:00.226654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fe1b8-ca61-4936-b9e2-17f0fc775583 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:00.228558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 242/474] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:00.233692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2a5f-eb34-4e92-8579-0f3a81ed0394 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:00.233980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2a5f-eb34-4e92-8579-0f3a81ed0394 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:00.234262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae2a5f-eb34-4e92-8579-0f3a81ed0394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:00.257640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7dae2a5f-eb34-4e92-8579-0f3a81ed0394 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:00.258880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7dae2a5f-eb34-4e92-8579-0f3a81ed0394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:00.283955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7ae5f-5275-4cc9-b372-79ba24c93988 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:00.323842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9324dca-1e1f-4344-ac3d-b9372765c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:00.324681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9324dca-1e1f-4344-ac3d-b9372765c84c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:00.324965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9324dca-1e1f-4344-ac3d-b9372765c84c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:00.325243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9324dca-1e1f-4344-ac3d-b9372765c84c None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:00.326102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9324dca-1e1f-4344-ac3d-b9372765c84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:00.326711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9324dca-1e1f-4344-ac3d-b9372765c84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:00.328088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9324dca-1e1f-4344-ac3d-b9372765c84c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:00.346576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 243/476] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:00.346777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 233/476] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:00.349710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9324dca-1e1f-4344-ac3d-b9372765c84c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:00.369931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2a5f-eb34-4e92-8579-0f3a81ed0394 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:00.393771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:00.423494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:00.487107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9324dca-1e1f-4344-ac3d-b9372765c84c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:00.494328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae2a5f-eb34-4e92-8579-0f3a81ed0394 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:00.532692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:00.533223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9f74-5b90-4452-a007-b7fca22e1c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:00.533856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9f74-5b90-4452-a007-b7fca22e1c9e None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:00.534143 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9f74-5b90-4452-a007-b7fca22e1c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:00.534245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:00.534416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee9f74-5b90-4452-a007-b7fca22e1c9e None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:00.534968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:00.535090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9f74-5b90-4452-a007-b7fca22e1c9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:00.535570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:00.537083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:00.537187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee9f74-5b90-4452-a007-b7fca22e1c9e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:00.538776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:00.548813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.sql.core [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 21:27:00.548813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 21:27:00.548813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [parameters: {'id': '8e3fffb2776d47eab65347927f46b699', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 21:27:00.548813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80434) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application result.read() Aug 02 21:27:00.569220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return ref.to_dict() Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:27:00.570392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application yield resource Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise self.value Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application session.commit() Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 21:27:00.572086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.session.flush() Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application compat.raise_( Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 21:27:00.574094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:27:00.576963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application result.read() Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:27:00.579014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [parameters: {'id': '8e3fffb2776d47eab65347927f46b699', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:00.581093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 21:27:00.584238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:00.587203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 234/477] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:00 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:00.591931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 244/478] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 21:27:00 2022] POST /identity/v3/roles => generated 144 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:00.596184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9f74-5b90-4452-a007-b7fca22e1c9e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:00.720498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee9f74-5b90-4452-a007-b7fca22e1c9e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:00.740786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:00.772172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33302115-b1db-4fb3-9d7f-2b2f65039aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:00.773171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302115-b1db-4fb3-9d7f-2b2f65039aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:00.773743 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302115-b1db-4fb3-9d7f-2b2f65039aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:00.774221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33302115-b1db-4fb3-9d7f-2b2f65039aa9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:00.792608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33302115-b1db-4fb3-9d7f-2b2f65039aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-33302115-b1db-4fb3-9d7f-2b2f65039aa9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:00.798602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:00.799441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:00.800727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:00.803110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 235/479] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:00.809000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:00.943358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:00.960492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d43ccf-d480-4752-b0a7-e9a1a11ec518 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:01.016928 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19e23c-182b-46f8-8c12-c56ce34469be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:01.017571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19e23c-182b-46f8-8c12-c56ce34469be None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:01.017854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19e23c-182b-46f8-8c12-c56ce34469be None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:01.018126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19e23c-182b-46f8-8c12-c56ce34469be None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:01.018860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19e23c-182b-46f8-8c12-c56ce34469be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:01.019168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19e23c-182b-46f8-8c12-c56ce34469be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:01.021184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19e23c-182b-46f8-8c12-c56ce34469be None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:01.030480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 245/480] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:01.788541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0950c79-4abc-4d36-ae25-e814afab6879 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:01.789077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0950c79-4abc-4d36-ae25-e814afab6879 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:01.789077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0950c79-4abc-4d36-ae25-e814afab6879 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:01.790678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 236/481] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:01.800440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef9d84-e38d-452e-b463-c76334f16c74 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:01.800952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef9d84-e38d-452e-b463-c76334f16c74 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:01.807069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef9d84-e38d-452e-b463-c76334f16c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:01.833523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-66ef9d84-e38d-452e-b463-c76334f16c74 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:01.834719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-66ef9d84-e38d-452e-b463-c76334f16c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:01.930718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 246/482] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:01.964852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0950c79-4abc-4d36-ae25-e814afab6879 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:02.093635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0950c79-4abc-4d36-ae25-e814afab6879 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:02.136585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c839d-5998-4f88-84dd-dab2bbd5a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:02.137591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c839d-5998-4f88-84dd-dab2bbd5a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.138063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c839d-5998-4f88-84dd-dab2bbd5a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.138558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c839d-5998-4f88-84dd-dab2bbd5a8f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.154394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c839d-5998-4f88-84dd-dab2bbd5a8f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-0a8c839d-5998-4f88-84dd-dab2bbd5a8f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:02.159903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:02.161506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:02.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:02.164531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 237/483] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:02.170646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef9d84-e38d-452e-b463-c76334f16c74 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:02.281839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:02.314088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef9d84-e38d-452e-b463-c76334f16c74 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:02.365833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2689da-4075-4704-83b2-809614865e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:02.366385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2689da-4075-4704-83b2-809614865e37 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.366668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2689da-4075-4704-83b2-809614865e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.366942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2689da-4075-4704-83b2-809614865e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.367663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2689da-4075-4704-83b2-809614865e37 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:02.367967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2689da-4075-4704-83b2-809614865e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:02.369369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2689da-4075-4704-83b2-809614865e37 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:02.384046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 247/484] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:02.389889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c839d-5998-4f88-84dd-dab2bbd5a8f9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:02.439444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:02.481040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e7be-5b6f-468d-9e61-70d0fd311b4f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.481322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e7be-5b6f-468d-9e61-70d0fd311b4f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.481599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e7be-5b6f-468d-9e61-70d0fd311b4f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.484211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 248/485] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:02.488342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b319e9-b428-45cf-8e03-56d9e4e0cf51 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.488658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b319e9-b428-45cf-8e03-56d9e4e0cf51 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.488975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b319e9-b428-45cf-8e03-56d9e4e0cf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.525067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-40b319e9-b428-45cf-8e03-56d9e4e0cf51 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:02.526315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-40b319e9-b428-45cf-8e03-56d9e4e0cf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:02.545326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c839d-5998-4f88-84dd-dab2bbd5a8f9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:02.594506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e0ca-d844-4677-9a17-e728d6da652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:02.595248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e0ca-d844-4677-9a17-e728d6da652b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.595530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e0ca-d844-4677-9a17-e728d6da652b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.595804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218e0ca-d844-4677-9a17-e728d6da652b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.616008 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e0ca-d844-4677-9a17-e728d6da652b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:02.617636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218e0ca-d844-4677-9a17-e728d6da652b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:02.635677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 249/486] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a218e0ca-d844-4677-9a17-e728d6da652b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:02.650655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:02.651489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:02.652375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:02.652375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:02.652375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:02.652375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:02.654536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 238/487] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:02.660034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b319e9-b428-45cf-8e03-56d9e4e0cf51 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:02.675944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e0ca-d844-4677-9a17-e728d6da652b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:02.788534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:02.824543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:02.844808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b319e9-b428-45cf-8e03-56d9e4e0cf51 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:02.856912 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218e0ca-d844-4677-9a17-e728d6da652b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:02.898764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89826a38-f44b-4ec4-b8e4-d3d59dff24af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:02.899306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89826a38-f44b-4ec4-b8e4-d3d59dff24af None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.899679 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89826a38-f44b-4ec4-b8e4-d3d59dff24af None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.899910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89826a38-f44b-4ec4-b8e4-d3d59dff24af None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.900646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89826a38-f44b-4ec4-b8e4-d3d59dff24af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:02.900958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89826a38-f44b-4ec4-b8e4-d3d59dff24af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:02.902346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89826a38-f44b-4ec4-b8e4-d3d59dff24af None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:02.902687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ec607-1480-41e5-8b00-353a9311210f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:02.903639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec607-1480-41e5-8b00-353a9311210f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.904111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec607-1480-41e5-8b00-353a9311210f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.904760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ec607-1480-41e5-8b00-353a9311210f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.914435 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 250/488] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:02.915675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d20c2-e3c7-44b0-8547-8c348ee16ea7 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.915948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d20c2-e3c7-44b0-8547-8c348ee16ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.916248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d20c2-e3c7-44b0-8547-8c348ee16ea7 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.916775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02ec607-1480-41e5-8b00-353a9311210f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:02.921438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 251/489] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:02.921438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d20c2-e3c7-44b0-8547-8c348ee16ea7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d02ec607-1480-41e5-8b00-353a9311210f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:02.927246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:02.928108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 239/490] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:02.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e20454-23f5-4d2e-b7f6-ba65afc67bdc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.933485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e20454-23f5-4d2e-b7f6-ba65afc67bdc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.933485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e20454-23f5-4d2e-b7f6-ba65afc67bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.951546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-45e20454-23f5-4d2e-b7f6-ba65afc67bdc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:02.952777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-45e20454-23f5-4d2e-b7f6-ba65afc67bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:03.043590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 240/491] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:03.044788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e20454-23f5-4d2e-b7f6-ba65afc67bdc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:03.062880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d20c2-e3c7-44b0-8547-8c348ee16ea7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.104474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:03.113739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54a922-7159-4cfd-8a5e-a941ef5fb606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:03.115281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54a922-7159-4cfd-8a5e-a941ef5fb606 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.115579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54a922-7159-4cfd-8a5e-a941ef5fb606 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.116120 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c54a922-7159-4cfd-8a5e-a941ef5fb606 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.125145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54a922-7159-4cfd-8a5e-a941ef5fb606 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:03.126603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c54a922-7159-4cfd-8a5e-a941ef5fb606 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:03.137716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8c54a922-7159-4cfd-8a5e-a941ef5fb606 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:03.139529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:03.140621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 252/492] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 21:27:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:03.142103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54a922-7159-4cfd-8a5e-a941ef5fb606 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:03.172235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e20454-23f5-4d2e-b7f6-ba65afc67bdc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.211074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e468ff-8308-42dd-8237-faf08a0c0fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:03.212045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e468ff-8308-42dd-8237-faf08a0c0fdc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.212547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e468ff-8308-42dd-8237-faf08a0c0fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.213015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e468ff-8308-42dd-8237-faf08a0c0fdc None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.214025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e468ff-8308-42dd-8237-faf08a0c0fdc None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:03.214647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e468ff-8308-42dd-8237-faf08a0c0fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:03.216376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e468ff-8308-42dd-8237-faf08a0c0fdc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:03.232321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 241/493] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:03.234383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e468ff-8308-42dd-8237-faf08a0c0fdc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:03.248051 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c54a922-7159-4cfd-8a5e-a941ef5fb606 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.287163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e1a3-8ed0-4986-881f-50922c6733d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:03.287831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e1a3-8ed0-4986-881f-50922c6733d9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.288167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e1a3-8ed0-4986-881f-50922c6733d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.288440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e1a3-8ed0-4986-881f-50922c6733d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.299191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2e1a3-8ed0-4986-881f-50922c6733d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-16d2e1a3-8ed0-4986-881f-50922c6733d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:03.305376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:03.306241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:03.307448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:03.311487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 253/494] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:03.312397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e1a3-8ed0-4986-881f-50922c6733d9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:03.374621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:03.376195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e468ff-8308-42dd-8237-faf08a0c0fdc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.421474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed059057-81b3-4f35-bffa-c44e211c489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:03.422905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed059057-81b3-4f35-bffa-c44e211c489a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.423408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed059057-81b3-4f35-bffa-c44e211c489a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.423880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed059057-81b3-4f35-bffa-c44e211c489a None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.425464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed059057-81b3-4f35-bffa-c44e211c489a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:03.425991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed059057-81b3-4f35-bffa-c44e211c489a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:03.428723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed059057-81b3-4f35-bffa-c44e211c489a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:03.438093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e1a3-8ed0-4986-881f-50922c6733d9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.446089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:03.474992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624c30af-3ff4-4470-ae4a-4e95968b7aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:03.475639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c30af-3ff4-4470-ae4a-4e95968b7aea None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.475921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c30af-3ff4-4470-ae4a-4e95968b7aea None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.476225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624c30af-3ff4-4470-ae4a-4e95968b7aea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.478292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 242/495] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 21:27:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:03.479159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed059057-81b3-4f35-bffa-c44e211c489a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:03.490176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c30af-3ff4-4470-ae4a-4e95968b7aea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:03.491755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624c30af-3ff4-4470-ae4a-4e95968b7aea None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-624c30af-3ff4-4470-ae4a-4e95968b7aea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:03.506226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:03.507268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:03.508310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:03.508310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:03.508310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:03.508310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:03.514307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 254/496] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:03.514307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6342fe3-3374-42b0-84e1-57fe9399997e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.514307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6342fe3-3374-42b0-84e1-57fe9399997e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.514307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6342fe3-3374-42b0-84e1-57fe9399997e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.514307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 255/497] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:03.517152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6342fe3-3374-42b0-84e1-57fe9399997e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:03.583228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed059057-81b3-4f35-bffa-c44e211c489a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.616445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f9af5-fe45-4ee7-9e32-00ae3418d5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:03.617064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f9af5-fe45-4ee7-9e32-00ae3418d5fc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.617347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f9af5-fe45-4ee7-9e32-00ae3418d5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.617738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f9af5-fe45-4ee7-9e32-00ae3418d5fc None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.618465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f9af5-fe45-4ee7-9e32-00ae3418d5fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:03.618614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:03.618765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f9af5-fe45-4ee7-9e32-00ae3418d5fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:03.620260 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f9af5-fe45-4ee7-9e32-00ae3418d5fc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:03.622370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6342fe3-3374-42b0-84e1-57fe9399997e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.628579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 243/498] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:03.629375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f9af5-fe45-4ee7-9e32-00ae3418d5fc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:03.658899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d333310-e285-4a49-802e-ec66ec4663d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:03.659511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333310-e285-4a49-802e-ec66ec4663d1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.659788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333310-e285-4a49-802e-ec66ec4663d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.660060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333310-e285-4a49-802e-ec66ec4663d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.691162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:03.731722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d333310-e285-4a49-802e-ec66ec4663d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:03.733241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d333310-e285-4a49-802e-ec66ec4663d1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:03.739947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f9af5-fe45-4ee7-9e32-00ae3418d5fc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.773273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe40e2-8f4d-49fe-8e36-ac93dd0708ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:03.773883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe40e2-8f4d-49fe-8e36-ac93dd0708ec None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.774173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe40e2-8f4d-49fe-8e36-ac93dd0708ec None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.774447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe40e2-8f4d-49fe-8e36-ac93dd0708ec None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.775136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe40e2-8f4d-49fe-8e36-ac93dd0708ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:03.775445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe40e2-8f4d-49fe-8e36-ac93dd0708ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:03.776839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe40e2-8f4d-49fe-8e36-ac93dd0708ec None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:03.789089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 244/499] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:03.790257 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053181e-55df-421a-bac6-d113f2e7849a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.790543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053181e-55df-421a-bac6-d113f2e7849a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.790818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053181e-55df-421a-bac6-d113f2e7849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.808305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7053181e-55df-421a-bac6-d113f2e7849a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:03.809490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7053181e-55df-421a-bac6-d113f2e7849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:03.833237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:03.837257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 256/500] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:03.838889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220830f2-128a-46e3-a144-09a08191b5fd None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.839581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220830f2-128a-46e3-a144-09a08191b5fd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.839864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220830f2-128a-46e3-a144-09a08191b5fd None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.844113 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 257/501] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:03.845665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220830f2-128a-46e3-a144-09a08191b5fd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:03.875609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 245/502] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:03.876462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053181e-55df-421a-bac6-d113f2e7849a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:03.922134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:03.953730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220830f2-128a-46e3-a144-09a08191b5fd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.975878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053181e-55df-421a-bac6-d113f2e7849a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:03.986252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaaec4-2024-4480-8722-faae6cff4a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:03.986880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaaec4-2024-4480-8722-faae6cff4a03 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:03.987155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaaec4-2024-4480-8722-faae6cff4a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:03.987425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaaec4-2024-4480-8722-faae6cff4a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:03.997805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaaec4-2024-4480-8722-faae6cff4a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:03.999285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aaaec4-2024-4480-8722-faae6cff4a03 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.009027 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90152-6eec-408b-8dac-d7a3a24d1b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.009651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90152-6eec-408b-8dac-d7a3a24d1b2d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.009931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90152-6eec-408b-8dac-d7a3a24d1b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.010197 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90152-6eec-408b-8dac-d7a3a24d1b2d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e8aaaec4-2024-4480-8722-faae6cff4a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:04.014543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:04.015455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:04.016290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:04.016290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:04.016290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:04.016290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:04.016290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 258/503] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:04.016538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaaec4-2024-4480-8722-faae6cff4a03 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.022263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90152-6eec-408b-8dac-d7a3a24d1b2d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.023729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c90152-6eec-408b-8dac-d7a3a24d1b2d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-63c90152-6eec-408b-8dac-d7a3a24d1b2d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:04.037956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:04.038993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:04.039872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 246/504] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:04.040975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639e210-915d-4c98-a462-13af2d98f67a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.040975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639e210-915d-4c98-a462-13af2d98f67a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.041090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639e210-915d-4c98-a462-13af2d98f67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.059515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7639e210-915d-4c98-a462-13af2d98f67a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:04.060736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7639e210-915d-4c98-a462-13af2d98f67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:04.073411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:04.119231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaaec4-2024-4480-8722-faae6cff4a03 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.126591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 247/505] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:04.127424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639e210-915d-4c98-a462-13af2d98f67a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.161827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:04.162267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cd33b-2a49-4496-b215-d9ce56ac102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.162950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cd33b-2a49-4496-b215-d9ce56ac102e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.163184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cd33b-2a49-4496-b215-d9ce56ac102e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.163461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901cd33b-2a49-4496-b215-d9ce56ac102e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.173779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cd33b-2a49-4496-b215-d9ce56ac102e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.175228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901cd33b-2a49-4496-b215-d9ce56ac102e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-901cd33b-2a49-4496-b215-d9ce56ac102e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:04.189366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:04.190351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:04.191215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:04.191215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:04.191215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:04.191215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:04.191215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 259/506] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:04.191772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cd33b-2a49-4496-b215-d9ce56ac102e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.229789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639e210-915d-4c98-a462-13af2d98f67a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.263047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16b014-36f1-408c-b05a-3b6636a85082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.263686 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b014-36f1-408c-b05a-3b6636a85082 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.263968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b014-36f1-408c-b05a-3b6636a85082 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.264284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16b014-36f1-408c-b05a-3b6636a85082 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.274227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16b014-36f1-408c-b05a-3b6636a85082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-fc16b014-36f1-408c-b05a-3b6636a85082 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:04.279149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:04.280477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 248/507] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:04.286183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16b014-36f1-408c-b05a-3b6636a85082 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.291852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901cd33b-2a49-4496-b215-d9ce56ac102e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.294199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:04.327941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e476-71cb-4ca6-819e-8de6a5a9206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.328578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e476-71cb-4ca6-819e-8de6a5a9206b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.328860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e476-71cb-4ca6-819e-8de6a5a9206b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.329130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114e476-71cb-4ca6-819e-8de6a5a9206b None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.329824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114e476-71cb-4ca6-819e-8de6a5a9206b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:04.330125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114e476-71cb-4ca6-819e-8de6a5a9206b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.331495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114e476-71cb-4ca6-819e-8de6a5a9206b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.342393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 260/508] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:04.343162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e476-71cb-4ca6-819e-8de6a5a9206b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.378289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:04.385088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16b014-36f1-408c-b05a-3b6636a85082 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.417935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798e5b-d14d-47b0-b395-72c6580241c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.418576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798e5b-d14d-47b0-b395-72c6580241c1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.418856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798e5b-d14d-47b0-b395-72c6580241c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.419131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f798e5b-d14d-47b0-b395-72c6580241c1 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.419926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798e5b-d14d-47b0-b395-72c6580241c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:04.420267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798e5b-d14d-47b0-b395-72c6580241c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.421716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f798e5b-d14d-47b0-b395-72c6580241c1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.438750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 249/509] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:04.438874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114e476-71cb-4ca6-819e-8de6a5a9206b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.439530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798e5b-d14d-47b0-b395-72c6580241c1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.472063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5677c-85ec-471c-970b-e097e630a09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.472725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5677c-85ec-471c-970b-e097e630a09d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.473008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5677c-85ec-471c-970b-e097e630a09d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.473309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5677c-85ec-471c-970b-e097e630a09d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.483576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5677c-85ec-471c-970b-e097e630a09d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.485022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5677c-85ec-471c-970b-e097e630a09d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-fda5677c-85ec-471c-970b-e097e630a09d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:04.500182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:04.501163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:04.502158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:04.502158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:04.502158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:04.502158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:04.502158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 261/510] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:04.502158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5677c-85ec-471c-970b-e097e630a09d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.521921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:04.541232 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f798e5b-d14d-47b0-b395-72c6580241c1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.574610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b37ad0-b198-48c3-8d6d-b6ecd2ef01ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.575298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b37ad0-b198-48c3-8d6d-b6ecd2ef01ef None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.575645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b37ad0-b198-48c3-8d6d-b6ecd2ef01ef None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.575983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b37ad0-b198-48c3-8d6d-b6ecd2ef01ef None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.576756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b37ad0-b198-48c3-8d6d-b6ecd2ef01ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:04.577130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b37ad0-b198-48c3-8d6d-b6ecd2ef01ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.578546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b37ad0-b198-48c3-8d6d-b6ecd2ef01ef None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.589432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 250/511] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:04.590216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b37ad0-b198-48c3-8d6d-b6ecd2ef01ef None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.605539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:04.606707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5677c-85ec-471c-970b-e097e630a09d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.643541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0df3d-7eda-476f-82d5-a2b1a00f6abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.644177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0df3d-7eda-476f-82d5-a2b1a00f6abd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.644463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0df3d-7eda-476f-82d5-a2b1a00f6abd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.644763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0df3d-7eda-476f-82d5-a2b1a00f6abd None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.645475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0df3d-7eda-476f-82d5-a2b1a00f6abd None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:04.645779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0df3d-7eda-476f-82d5-a2b1a00f6abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.647217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0df3d-7eda-476f-82d5-a2b1a00f6abd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.655241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 262/512] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:04.656019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0df3d-7eda-476f-82d5-a2b1a00f6abd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.697541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b37ad0-b198-48c3-8d6d-b6ecd2ef01ef None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.730226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c3f11-f4d2-4927-b2d7-caf8b359cc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.731013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c3f11-f4d2-4927-b2d7-caf8b359cc0e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.731383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c3f11-f4d2-4927-b2d7-caf8b359cc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.731660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c3f11-f4d2-4927-b2d7-caf8b359cc0e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.734369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:04.740354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c3f11-f4d2-4927-b2d7-caf8b359cc0e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.741799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c3f11-f4d2-4927-b2d7-caf8b359cc0e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-281c3f11-f4d2-4927-b2d7-caf8b359cc0e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:04.752862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:04.753865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 251/513] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:04.759477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c3f11-f4d2-4927-b2d7-caf8b359cc0e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.760337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0df3d-7eda-476f-82d5-a2b1a00f6abd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.791436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57c24-ebc0-4a1d-aa30-8241c8ef5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.792054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57c24-ebc0-4a1d-aa30-8241c8ef5d71 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.792364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57c24-ebc0-4a1d-aa30-8241c8ef5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.792639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d57c24-ebc0-4a1d-aa30-8241c8ef5d71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.827721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:04.854639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c3f11-f4d2-4927-b2d7-caf8b359cc0e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:04.861174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57c24-ebc0-4a1d-aa30-8241c8ef5d71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.862639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d57c24-ebc0-4a1d-aa30-8241c8ef5d71 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.887267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d20c-55cb-4c8d-acea-8a1a284ea2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:04.887880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d20c-55cb-4c8d-acea-8a1a284ea2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:04.888261 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d20c-55cb-4c8d-acea-8a1a284ea2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:04.888541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6d20c-55cb-4c8d-acea-8a1a284ea2b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:04.889254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d20c-55cb-4c8d-acea-8a1a284ea2b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:04.889560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d20c-55cb-4c8d-acea-8a1a284ea2b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:04.890921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6d20c-55cb-4c8d-acea-8a1a284ea2b8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:04.906808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 252/514] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:04.906808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d20c-55cb-4c8d-acea-8a1a284ea2b8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:04.936692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:04.958393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 263/515] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:04.959199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57c24-ebc0-4a1d-aa30-8241c8ef5d71 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.004374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6d20c-55cb-4c8d-acea-8a1a284ea2b8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.037811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7429-bc3c-49b2-9ca0-1477010d181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.038528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7429-bc3c-49b2-9ca0-1477010d181c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.038879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7429-bc3c-49b2-9ca0-1477010d181c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.039165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe7429-bc3c-49b2-9ca0-1477010d181c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.041103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.046461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7429-bc3c-49b2-9ca0-1477010d181c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.048063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe7429-bc3c-49b2-9ca0-1477010d181c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.057593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d57c24-ebc0-4a1d-aa30-8241c8ef5d71 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8abe7429-bc3c-49b2-9ca0-1477010d181c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:05.061406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:05.062315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:05.063117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:05.063117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:05.063117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:05.063117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:05.063117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:05.063117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:05.063117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:05.063117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:05.068290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 253/516] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:05.069786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7429-bc3c-49b2-9ca0-1477010d181c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.095477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c31ab9-a45d-4b72-9480-ebbe2852b697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.096119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c31ab9-a45d-4b72-9480-ebbe2852b697 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.096426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c31ab9-a45d-4b72-9480-ebbe2852b697 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.096706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c31ab9-a45d-4b72-9480-ebbe2852b697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.107284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c31ab9-a45d-4b72-9480-ebbe2852b697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.108792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c31ab9-a45d-4b72-9480-ebbe2852b697 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-49c31ab9-a45d-4b72-9480-ebbe2852b697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:05.123264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:05.124117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:05.124964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:05.124964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:05.124964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:05.124964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:05.124964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 264/517] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:05.125225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c31ab9-a45d-4b72-9480-ebbe2852b697 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.156243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.174085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe7429-bc3c-49b2-9ca0-1477010d181c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.206380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a7d2a-4ac1-48ca-8481-462390189728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.206986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a7d2a-4ac1-48ca-8481-462390189728 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.207264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a7d2a-4ac1-48ca-8481-462390189728 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.208050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a7d2a-4ac1-48ca-8481-462390189728 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.208856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a7d2a-4ac1-48ca-8481-462390189728 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:05.209164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a7d2a-4ac1-48ca-8481-462390189728 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.210573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a7d2a-4ac1-48ca-8481-462390189728 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.223175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c31ab9-a45d-4b72-9480-ebbe2852b697 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.227765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 254/518] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:05.228568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a7d2a-4ac1-48ca-8481-462390189728 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.256824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5eed19-6493-42b8-8ec3-c8387c6a3831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.257368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eed19-6493-42b8-8ec3-c8387c6a3831 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.257646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eed19-6493-42b8-8ec3-c8387c6a3831 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.257912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5eed19-6493-42b8-8ec3-c8387c6a3831 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.258577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5eed19-6493-42b8-8ec3-c8387c6a3831 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.260003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5eed19-6493-42b8-8ec3-c8387c6a3831 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.281519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.281970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 265/519] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:05 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:05.283156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5eed19-6493-42b8-8ec3-c8387c6a3831 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.345426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a7d2a-4ac1-48ca-8481-462390189728 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.383432 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.385568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd387d15-d2b3-4bbb-8369-e5091a66c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.386238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd387d15-d2b3-4bbb-8369-e5091a66c18f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.386549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd387d15-d2b3-4bbb-8369-e5091a66c18f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.386850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd387d15-d2b3-4bbb-8369-e5091a66c18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.400275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd387d15-d2b3-4bbb-8369-e5091a66c18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.401767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd387d15-d2b3-4bbb-8369-e5091a66c18f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.404448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5eed19-6493-42b8-8ec3-c8387c6a3831 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-fd387d15-d2b3-4bbb-8369-e5091a66c18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:05.420227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:05.421162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:05.422039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:05.422039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:05.422039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:05.422039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:05.426236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 255/520] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:05.427096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd387d15-d2b3-4bbb-8369-e5091a66c18f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.446573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b144-b485-4cc7-8c88-cb05d5a49e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.447533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b144-b485-4cc7-8c88-cb05d5a49e2a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.447533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b144-b485-4cc7-8c88-cb05d5a49e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.447723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2b144-b485-4cc7-8c88-cb05d5a49e2a None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.448511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b144-b485-4cc7-8c88-cb05d5a49e2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:05.448815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b144-b485-4cc7-8c88-cb05d5a49e2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.450243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2b144-b485-4cc7-8c88-cb05d5a49e2a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.468709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 266/521] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:05.469539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b144-b485-4cc7-8c88-cb05d5a49e2a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.540353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd387d15-d2b3-4bbb-8369-e5091a66c18f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.543795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.577871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acc0b8-a6af-4762-9ed3-ebdc0cf828c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.578489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc0b8-a6af-4762-9ed3-ebdc0cf828c9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.578772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc0b8-a6af-4762-9ed3-ebdc0cf828c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.579048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc0b8-a6af-4762-9ed3-ebdc0cf828c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.579737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acc0b8-a6af-4762-9ed3-ebdc0cf828c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:05.580158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acc0b8-a6af-4762-9ed3-ebdc0cf828c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.581446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acc0b8-a6af-4762-9ed3-ebdc0cf828c9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.582198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2b144-b485-4cc7-8c88-cb05d5a49e2a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.594184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 256/522] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:05.594866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acc0b8-a6af-4762-9ed3-ebdc0cf828c9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.626839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5dd39d-303d-41dc-96ab-8c61eed53f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.627466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5dd39d-303d-41dc-96ab-8c61eed53f7c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.627749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5dd39d-303d-41dc-96ab-8c61eed53f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.628027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5dd39d-303d-41dc-96ab-8c61eed53f7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.647214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.702040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5dd39d-303d-41dc-96ab-8c61eed53f7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.703562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5dd39d-303d-41dc-96ab-8c61eed53f7c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.710382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acc0b8-a6af-4762-9ed3-ebdc0cf828c9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.746861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511d549-75fa-4991-84b9-2e71df0bdcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.747522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511d549-75fa-4991-84b9-2e71df0bdcde None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.747807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511d549-75fa-4991-84b9-2e71df0bdcde None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.748083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511d549-75fa-4991-84b9-2e71df0bdcde None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.748788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511d549-75fa-4991-84b9-2e71df0bdcde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:05.749093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511d549-75fa-4991-84b9-2e71df0bdcde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.750444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511d549-75fa-4991-84b9-2e71df0bdcde None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.763269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 257/523] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:05.763915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511d549-75fa-4991-84b9-2e71df0bdcde None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.791386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.814992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 267/524] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:05.820195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5dd39d-303d-41dc-96ab-8c61eed53f7c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.865299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.881687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511d549-75fa-4991-84b9-2e71df0bdcde None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.916180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081a75b-9c7a-4272-bedb-904951f4fe66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.916796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081a75b-9c7a-4272-bedb-904951f4fe66 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.917084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081a75b-9c7a-4272-bedb-904951f4fe66 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.917360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081a75b-9c7a-4272-bedb-904951f4fe66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.918145 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081a75b-9c7a-4272-bedb-904951f4fe66 None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=cab044fcd0dd449eafaccb81606d15ce) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:05.918453 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081a75b-9c7a-4272-bedb-904951f4fe66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.919884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8081a75b-9c7a-4272-bedb-904951f4fe66 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.924047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5dd39d-303d-41dc-96ab-8c61eed53f7c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.925616 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 258/525] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/role_assignments?user.id=cab044fcd0dd449eafaccb81606d15ce&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:05.926851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081a75b-9c7a-4272-bedb-904951f4fe66 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.975906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aa852-f09f-401f-9868-b8f60603c6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.976659 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa852-f09f-401f-9868-b8f60603c6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.976947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa852-f09f-401f-9868-b8f60603c6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.977222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa852-f09f-401f-9868-b8f60603c6f7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.990273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aa852-f09f-401f-9868-b8f60603c6f7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.991795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aa852-f09f-401f-9868-b8f60603c6f7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-0f9aa852-f09f-401f-9868-b8f60603c6f7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:06.005806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:06.006733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:27:06.007594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:06.011939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 268/526] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:06.013027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aa852-f09f-401f-9868-b8f60603c6f7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.057632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.077073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081a75b-9c7a-4272-bedb-904951f4fe66 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.121718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691fa53-f8ae-40da-b8b9-9696c1bcf7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.122891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691fa53-f8ae-40da-b8b9-9696c1bcf7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.123320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691fa53-f8ae-40da-b8b9-9696c1bcf7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.123872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691fa53-f8ae-40da-b8b9-9696c1bcf7d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.127208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aa852-f09f-401f-9868-b8f60603c6f7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.133045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691fa53-f8ae-40da-b8b9-9696c1bcf7d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.135090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691fa53-f8ae-40da-b8b9-9696c1bcf7d6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.137889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c691fa53-f8ae-40da-b8b9-9696c1bcf7d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:06.150752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:06.151604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:06.152438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:06.152438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:06.152438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:06.152438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:06.152438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:06.152438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:06.152438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:06.152438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:06.153471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 259/527] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:06.154104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691fa53-f8ae-40da-b8b9-9696c1bcf7d6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.168768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c6b1-4e4d-4eb2-9b16-a72c6233464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.169412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c6b1-4e4d-4eb2-9b16-a72c6233464b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.169696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c6b1-4e4d-4eb2-9b16-a72c6233464b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.169971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c6b1-4e4d-4eb2-9b16-a72c6233464b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.182060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8c6b1-4e4d-4eb2-9b16-a72c6233464b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.183602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8c6b1-4e4d-4eb2-9b16-a72c6233464b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c5d8c6b1-4e4d-4eb2-9b16-a72c6233464b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:06.198376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:06.199300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:06.200122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:06.200122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:06.200122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:06.200122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:06.204538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 269/528] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:06.204984 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c6b1-4e4d-4eb2-9b16-a72c6233464b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.299314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691fa53-f8ae-40da-b8b9-9696c1bcf7d6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.316668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c6b1-4e4d-4eb2-9b16-a72c6233464b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.353615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13155964-eff9-48f2-8aa7-9739b96acc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.354542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e93fa-9c61-4a15-9f8e-8995b2990e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.354930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13155964-eff9-48f2-8aa7-9739b96acc55 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.355160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e93fa-9c61-4a15-9f8e-8995b2990e6a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.355444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e93fa-9c61-4a15-9f8e-8995b2990e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.355727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e93fa-9c61-4a15-9f8e-8995b2990e6a None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.356043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13155964-eff9-48f2-8aa7-9739b96acc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.356515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e93fa-9c61-4a15-9f8e-8995b2990e6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:06.356735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13155964-eff9-48f2-8aa7-9739b96acc55 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.356845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e93fa-9c61-4a15-9f8e-8995b2990e6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.357831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13155964-eff9-48f2-8aa7-9739b96acc55 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:06.358254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e93fa-9c61-4a15-9f8e-8995b2990e6a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.358530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13155964-eff9-48f2-8aa7-9739b96acc55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.360465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13155964-eff9-48f2-8aa7-9739b96acc55 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.371517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 270/529] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.372376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e93fa-9c61-4a15-9f8e-8995b2990e6a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.384430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 260/530] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.386130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13155964-eff9-48f2-8aa7-9739b96acc55 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.392537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.397910 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.511461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e93fa-9c61-4a15-9f8e-8995b2990e6a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.524022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13155964-eff9-48f2-8aa7-9739b96acc55 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.552285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef2849-9a42-4913-8225-eff096bee117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.552900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef2849-9a42-4913-8225-eff096bee117 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.553187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef2849-9a42-4913-8225-eff096bee117 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.553459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef2849-9a42-4913-8225-eff096bee117 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.554152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef2849-9a42-4913-8225-eff096bee117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:06.554453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef2849-9a42-4913-8225-eff096bee117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.555894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef2849-9a42-4913-8225-eff096bee117 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.565031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57de9c-1c48-44b2-b2ca-da54561f98df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.565654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57de9c-1c48-44b2-b2ca-da54561f98df None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.565936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57de9c-1c48-44b2-b2ca-da54561f98df None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.566208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57de9c-1c48-44b2-b2ca-da54561f98df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.567091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57de9c-1c48-44b2-b2ca-da54561f98df None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=124c246d00a841608a2bc4f5230f4eaf) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:06.567344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57de9c-1c48-44b2-b2ca-da54561f98df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.567787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 271/531] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.568783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef2849-9a42-4913-8225-eff096bee117 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.568891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57de9c-1c48-44b2-b2ca-da54561f98df None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.575280 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 261/532] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/role_assignments?user.id=124c246d00a841608a2bc4f5230f4eaf&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.576086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57de9c-1c48-44b2-b2ca-da54561f98df None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.674101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.730480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.744655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57de9c-1c48-44b2-b2ca-da54561f98df None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.781676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef2849-9a42-4913-8225-eff096bee117 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.806521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294bba0-4f84-4f66-bd5c-1d6105e3e1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.806521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294bba0-4f84-4f66-bd5c-1d6105e3e1df None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.806521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294bba0-4f84-4f66-bd5c-1d6105e3e1df None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.806521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1294bba0-4f84-4f66-bd5c-1d6105e3e1df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.820331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294bba0-4f84-4f66-bd5c-1d6105e3e1df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.821733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1294bba0-4f84-4f66-bd5c-1d6105e3e1df None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1294bba0-4f84-4f66-bd5c-1d6105e3e1df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:06.842410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:06.843275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:06.844091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:06.844091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:06.844091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:06.844091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:06.844091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:06.844091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:06.844091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:06.844091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:06.844958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 262/533] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:06.846253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956b81f-a44d-4e37-a03c-ce78ed22e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.846877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956b81f-a44d-4e37-a03c-ce78ed22e42b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.847154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956b81f-a44d-4e37-a03c-ce78ed22e42b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.847421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956b81f-a44d-4e37-a03c-ce78ed22e42b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.851735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294bba0-4f84-4f66-bd5c-1d6105e3e1df None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.992611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956b81f-a44d-4e37-a03c-ce78ed22e42b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.994082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956b81f-a44d-4e37-a03c-ce78ed22e42b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.022860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1294bba0-4f84-4f66-bd5c-1d6105e3e1df None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.080708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.092162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a655565-35af-416a-9173-e9cd45c7cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.094914 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a655565-35af-416a-9173-e9cd45c7cf12 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.095200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a655565-35af-416a-9173-e9cd45c7cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.095475 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a655565-35af-416a-9173-e9cd45c7cf12 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.096270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a655565-35af-416a-9173-e9cd45c7cf12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:07.096584 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a655565-35af-416a-9173-e9cd45c7cf12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.098530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a655565-35af-416a-9173-e9cd45c7cf12 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.143837 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 263/534] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:07.145142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.149434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a655565-35af-416a-9173-e9cd45c7cf12 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.174621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 272/535] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:07.175923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956b81f-a44d-4e37-a03c-ce78ed22e42b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.266685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a655565-35af-416a-9173-e9cd45c7cf12 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.303049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1d83-e2ac-4511-ac60-b958d97542ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.303675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1d83-e2ac-4511-ac60-b958d97542ad None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.303955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1d83-e2ac-4511-ac60-b958d97542ad None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.304255 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e1d83-e2ac-4511-ac60-b958d97542ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.305042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1d83-e2ac-4511-ac60-b958d97542ad None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=4e3cd62eb975492aab4a136c0e9825a9) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:07.305352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1d83-e2ac-4511-ac60-b958d97542ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.306774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e1d83-e2ac-4511-ac60-b958d97542ad None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.312803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 264/536] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/role_assignments?user.id=4e3cd62eb975492aab4a136c0e9825a9&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:07.344716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956b81f-a44d-4e37-a03c-ce78ed22e42b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.399528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b225df-c9bd-40b0-b8d3-8efb94530890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.400225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b225df-c9bd-40b0-b8d3-8efb94530890 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.400507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b225df-c9bd-40b0-b8d3-8efb94530890 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.400778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b225df-c9bd-40b0-b8d3-8efb94530890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.421279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b225df-c9bd-40b0-b8d3-8efb94530890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.422759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b225df-c9bd-40b0-b8d3-8efb94530890 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-59b225df-c9bd-40b0-b8d3-8efb94530890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:07.444949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:07.447011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:07.449086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:07.449086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:07.449086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:07.449086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:07.449086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 273/537] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:07.451979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1d83-e2ac-4511-ac60-b958d97542ad None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.486128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d9b7-018c-46cc-a53d-2d42e7298199 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.486432 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d9b7-018c-46cc-a53d-2d42e7298199 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.486673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004d9b7-018c-46cc-a53d-2d42e7298199 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.489453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 274/538] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:07.493574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c3ab2-5789-4179-9e26-1d13be0ce59e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.493860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c3ab2-5789-4179-9e26-1d13be0ce59e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.494136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c3ab2-5789-4179-9e26-1d13be0ce59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.523488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.529252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9e8c3ab2-5789-4179-9e26-1d13be0ce59e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:07.530731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9e8c3ab2-5789-4179-9e26-1d13be0ce59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:07.572585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e1d83-e2ac-4511-ac60-b958d97542ad None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.593188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.611875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b3044-b4d2-4bf2-917f-ff191640663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.612809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b3044-b4d2-4bf2-917f-ff191640663d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.613235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b3044-b4d2-4bf2-917f-ff191640663d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.613815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b3044-b4d2-4bf2-917f-ff191640663d None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.614652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b3044-b4d2-4bf2-917f-ff191640663d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:07.615118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b3044-b4d2-4bf2-917f-ff191640663d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.616747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b3044-b4d2-4bf2-917f-ff191640663d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.630402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 265/539] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:07.641330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b3044-b4d2-4bf2-917f-ff191640663d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.668327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 275/540] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:07.699270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c3ab2-5789-4179-9e26-1d13be0ce59e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.831160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c3ab2-5789-4179-9e26-1d13be0ce59e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.867073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b3044-b4d2-4bf2-917f-ff191640663d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.868737 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41939a64-f9ee-435f-bfb3-24a1398c273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.869703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939a64-f9ee-435f-bfb3-24a1398c273f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.870198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939a64-f9ee-435f-bfb3-24a1398c273f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.870667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41939a64-f9ee-435f-bfb3-24a1398c273f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.881830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41939a64-f9ee-435f-bfb3-24a1398c273f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-41939a64-f9ee-435f-bfb3-24a1398c273f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:07.887375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:07.888315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:07.889070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:07.891875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.893091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 276/541] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:07.905528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41939a64-f9ee-435f-bfb3-24a1398c273f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.918663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e661d-9486-453f-abe3-803e1a06c4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.919317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e661d-9486-453f-abe3-803e1a06c4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.919600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e661d-9486-453f-abe3-803e1a06c4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.919875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e661d-9486-453f-abe3-803e1a06c4f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.927326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e661d-9486-453f-abe3-803e1a06c4f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.928827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e661d-9486-453f-abe3-803e1a06c4f8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f78e661d-9486-453f-abe3-803e1a06c4f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:07.941401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:07.943006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:07.943804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:07.943804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:07.943804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:07.943804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:07.943804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:07.943804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:07.943804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:07.943804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:07.943804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 266/542] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:07.945363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.949939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e661d-9486-453f-abe3-803e1a06c4f8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.034353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41939a64-f9ee-435f-bfb3-24a1398c273f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.077182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faa148-feae-4abc-b64e-b3ac270a0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.078149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faa148-feae-4abc-b64e-b3ac270a0aad None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.078626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faa148-feae-4abc-b64e-b3ac270a0aad None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.079116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faa148-feae-4abc-b64e-b3ac270a0aad None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.080025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faa148-feae-4abc-b64e-b3ac270a0aad None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:08.080562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faa148-feae-4abc-b64e-b3ac270a0aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.083095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faa148-feae-4abc-b64e-b3ac270a0aad None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.094215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 277/543] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:08.100030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faa148-feae-4abc-b64e-b3ac270a0aad None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.187345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e661d-9486-453f-abe3-803e1a06c4f8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.199455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:08.219013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faa148-feae-4abc-b64e-b3ac270a0aad None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.237507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34e98f-8a5b-4dac-a909-4c395fd66043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.238419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e98f-8a5b-4dac-a909-4c395fd66043 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.239938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e98f-8a5b-4dac-a909-4c395fd66043 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.240435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e98f-8a5b-4dac-a909-4c395fd66043 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.241634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34e98f-8a5b-4dac-a909-4c395fd66043 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:08.242387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34e98f-8a5b-4dac-a909-4c395fd66043 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.244774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34e98f-8a5b-4dac-a909-4c395fd66043 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.254158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428c4bc-34c1-4b19-9027-d779ed951216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.255605 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428c4bc-34c1-4b19-9027-d779ed951216 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.255605 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428c4bc-34c1-4b19-9027-d779ed951216 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.255896 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428c4bc-34c1-4b19-9027-d779ed951216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.262155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 267/544] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:08.264350 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039866f-3480-43e5-b686-38953d803bab None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.265322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039866f-3480-43e5-b686-38953d803bab None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.265827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039866f-3480-43e5-b686-38953d803bab None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.266968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428c4bc-34c1-4b19-9027-d779ed951216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.268051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 268/545] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:08.268974 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039866f-3480-43e5-b686-38953d803bab None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.272369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428c4bc-34c1-4b19-9027-d779ed951216 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9428c4bc-34c1-4b19-9027-d779ed951216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:08.287439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:08.288324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:08.289130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:08.289130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:08.289130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:08.289130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:08.289130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 278/546] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:08.290083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196d8b-87c4-45d1-9b73-1c4f17227953 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.290370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196d8b-87c4-45d1-9b73-1c4f17227953 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.290649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e196d8b-87c4-45d1-9b73-1c4f17227953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.308820 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8e196d8b-87c4-45d1-9b73-1c4f17227953 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:08.309984 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8e196d8b-87c4-45d1-9b73-1c4f17227953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:08.316733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:08.387841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039866f-3480-43e5-b686-38953d803bab None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.408283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 279/547] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:08.408283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196d8b-87c4-45d1-9b73-1c4f17227953 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.446884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651509a-e450-4880-a069-9e5e861bdd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.447654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651509a-e450-4880-a069-9e5e861bdd47 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.447977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651509a-e450-4880-a069-9e5e861bdd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.448298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651509a-e450-4880-a069-9e5e861bdd47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.449155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651509a-e450-4880-a069-9e5e861bdd47 None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=24644cede7e149a6b3e5bd39b930017b) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:08.449474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651509a-e450-4880-a069-9e5e861bdd47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.450909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651509a-e450-4880-a069-9e5e861bdd47 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.457355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 269/548] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/role_assignments?user.id=24644cede7e149a6b3e5bd39b930017b&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:08.458339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651509a-e450-4880-a069-9e5e861bdd47 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.510424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:08.564382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e196d8b-87c4-45d1-9b73-1c4f17227953 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.577637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:08.581831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651509a-e450-4880-a069-9e5e861bdd47 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.605276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c390d3-3f59-4ee8-a21f-87c44d2baab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.606274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c390d3-3f59-4ee8-a21f-87c44d2baab7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.606794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c390d3-3f59-4ee8-a21f-87c44d2baab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.607302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c390d3-3f59-4ee8-a21f-87c44d2baab7 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.608237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c390d3-3f59-4ee8-a21f-87c44d2baab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:08.608736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c390d3-3f59-4ee8-a21f-87c44d2baab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.610301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c390d3-3f59-4ee8-a21f-87c44d2baab7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.622628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d43b9-f52e-493a-a0b1-9cc0ac1fc19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.623297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d43b9-f52e-493a-a0b1-9cc0ac1fc19f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.623640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d43b9-f52e-493a-a0b1-9cc0ac1fc19f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.623867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d43b9-f52e-493a-a0b1-9cc0ac1fc19f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.626506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 280/549] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:08.633032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c390d3-3f59-4ee8-a21f-87c44d2baab7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.643624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d43b9-f52e-493a-a0b1-9cc0ac1fc19f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ce4d43b9-f52e-493a-a0b1-9cc0ac1fc19f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:08.650322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:08.651783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:08.652767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:08.657646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 270/550] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:08.662060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d43b9-f52e-493a-a0b1-9cc0ac1fc19f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.780449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c390d3-3f59-4ee8-a21f-87c44d2baab7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.817242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:08.831536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283a78c-38d4-443b-a7e3-4b5f769fbbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.832956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283a78c-38d4-443b-a7e3-4b5f769fbbfc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.833394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283a78c-38d4-443b-a7e3-4b5f769fbbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.833999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283a78c-38d4-443b-a7e3-4b5f769fbbfc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.843267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283a78c-38d4-443b-a7e3-4b5f769fbbfc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.845416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283a78c-38d4-443b-a7e3-4b5f769fbbfc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.848811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d43b9-f52e-493a-a0b1-9cc0ac1fc19f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5283a78c-38d4-443b-a7e3-4b5f769fbbfc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:08.859511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:08.860550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:08.861448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:08.864413 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 281/551] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:08.870147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283a78c-38d4-443b-a7e3-4b5f769fbbfc None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.905508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2e10f-7ca8-47a9-ac30-80c0e5fa6e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.906304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2e10f-7ca8-47a9-ac30-80c0e5fa6e4c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.906676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2e10f-7ca8-47a9-ac30-80c0e5fa6e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.907021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2e10f-7ca8-47a9-ac30-80c0e5fa6e4c None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.907803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2e10f-7ca8-47a9-ac30-80c0e5fa6e4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:08.908203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2e10f-7ca8-47a9-ac30-80c0e5fa6e4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.909692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2e10f-7ca8-47a9-ac30-80c0e5fa6e4c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.919284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 271/552] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:08.924888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2e10f-7ca8-47a9-ac30-80c0e5fa6e4c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.948043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:09.004931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283a78c-38d4-443b-a7e3-4b5f769fbbfc None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:09.045568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2e10f-7ca8-47a9-ac30-80c0e5fa6e4c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:09.054476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e8b0-8246-464c-a33c-6f7635cb0081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:09.056167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e8b0-8246-464c-a33c-6f7635cb0081 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.056658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e8b0-8246-464c-a33c-6f7635cb0081 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.057520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e8b0-8246-464c-a33c-6f7635cb0081 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.058797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e8b0-8246-464c-a33c-6f7635cb0081 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:09.059306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e8b0-8246-464c-a33c-6f7635cb0081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:09.061724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9e8b0-8246-464c-a33c-6f7635cb0081 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:09.083275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d4399-f101-450c-9101-060580c9baee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:09.084030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d4399-f101-450c-9101-060580c9baee None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.084449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d4399-f101-450c-9101-060580c9baee None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.084796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d4399-f101-450c-9101-060580c9baee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.097299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d4399-f101-450c-9101-060580c9baee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:09.099404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d4399-f101-450c-9101-060580c9baee None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:09.110204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 282/553] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:09.111697 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69528ea0-c0d9-4324-98e5-6fe6877d34a0 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.112185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69528ea0-c0d9-4324-98e5-6fe6877d34a0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.112637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69528ea0-c0d9-4324-98e5-6fe6877d34a0 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.114429 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 283/554] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:09.115305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69528ea0-c0d9-4324-98e5-6fe6877d34a0 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-875d4399-f101-450c-9101-060580c9baee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:09.120885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:09.121848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:09.122706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:09.122706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:09.122706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:09.122706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:09.122706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 272/555] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:09.123377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e9b9c-b0cb-4ee8-b405-a090e883d7bb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.123548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e9b9c-b0cb-4ee8-b405-a090e883d7bb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.128085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e9b9c-b0cb-4ee8-b405-a090e883d7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.156576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-570e9b9c-b0cb-4ee8-b405-a090e883d7bb None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:09.159029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-570e9b9c-b0cb-4ee8-b405-a090e883d7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:09.175479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:09.246819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69528ea0-c0d9-4324-98e5-6fe6877d34a0 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:09.265806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 273/556] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:09.265806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e9b9c-b0cb-4ee8-b405-a090e883d7bb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:09.268494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:09.304620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36028e9-251a-4867-8935-6ebdbc556659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:09.306250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36028e9-251a-4867-8935-6ebdbc556659 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.306736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36028e9-251a-4867-8935-6ebdbc556659 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.307464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36028e9-251a-4867-8935-6ebdbc556659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.381923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36028e9-251a-4867-8935-6ebdbc556659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:09.383398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36028e9-251a-4867-8935-6ebdbc556659 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:09.405170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e9b9c-b0cb-4ee8-b405-a090e883d7bb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:09.434661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:09.443724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e5348-1e31-44b1-ae42-8cb8333bb6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:09.444406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e5348-1e31-44b1-ae42-8cb8333bb6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.444690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e5348-1e31-44b1-ae42-8cb8333bb6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.444955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e5348-1e31-44b1-ae42-8cb8333bb6e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.445701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e5348-1e31-44b1-ae42-8cb8333bb6e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:09.445957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e5348-1e31-44b1-ae42-8cb8333bb6e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:09.447375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e5348-1e31-44b1-ae42-8cb8333bb6e2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:09.463915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 274/557] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:09.463915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e5348-1e31-44b1-ae42-8cb8333bb6e2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:09.508748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 284/558] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:09.509798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36028e9-251a-4867-8935-6ebdbc556659 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:09.546483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:09.602185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e5348-1e31-44b1-ae42-8cb8333bb6e2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:09.632166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36028e9-251a-4867-8935-6ebdbc556659 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:09.645813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890e68-8508-4504-be57-2c942a8d75f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:09.646651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890e68-8508-4504-be57-2c942a8d75f8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.647227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890e68-8508-4504-be57-2c942a8d75f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.647667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e890e68-8508-4504-be57-2c942a8d75f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.662312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e890e68-8508-4504-be57-2c942a8d75f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3e890e68-8508-4504-be57-2c942a8d75f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:09.668511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:09.669849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:09.671061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:09.671671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906fff28-9dbb-460c-90b6-f63a8766af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:09.671671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fff28-9dbb-460c-90b6-f63a8766af68 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.671671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fff28-9dbb-460c-90b6-f63a8766af68 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.671671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906fff28-9dbb-460c-90b6-f63a8766af68 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.674464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 275/559] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:09.675134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890e68-8508-4504-be57-2c942a8d75f8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:09.678240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fff28-9dbb-460c-90b6-f63a8766af68 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:09.679838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906fff28-9dbb-460c-90b6-f63a8766af68 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-906fff28-9dbb-460c-90b6-f63a8766af68 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:09.692337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:09.693365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:09.694243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 285/560] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 21:27:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:09.695842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91416d61-e37d-43a4-a445-4c8d34796907 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.695842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91416d61-e37d-43a4-a445-4c8d34796907 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.695842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91416d61-e37d-43a4-a445-4c8d34796907 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.700556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 286/561] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:09.700556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91416d61-e37d-43a4-a445-4c8d34796907 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:09.703128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:09.786019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e890e68-8508-4504-be57-2c942a8d75f8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:09.816221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:09.828710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9804d66-b986-4be4-b4ce-2ba51637d6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:09.829354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9804d66-b986-4be4-b4ce-2ba51637d6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.829719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9804d66-b986-4be4-b4ce-2ba51637d6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.829986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9804d66-b986-4be4-b4ce-2ba51637d6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.830765 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91416d61-e37d-43a4-a445-4c8d34796907 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:09.841372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9804d66-b986-4be4-b4ce-2ba51637d6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:09.842826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9804d66-b986-4be4-b4ce-2ba51637d6e0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f9804d66-b986-4be4-b4ce-2ba51637d6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:09.862525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:09.863399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:09.864395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:09.864395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:09.864395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:09.864395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:09.864395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 276/562] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:09.864656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9804d66-b986-4be4-b4ce-2ba51637d6e0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:09.876030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ed1cd-bf24-4410-a017-cbc90f2eace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:09.876713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed1cd-bf24-4410-a017-cbc90f2eace9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.876996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed1cd-bf24-4410-a017-cbc90f2eace9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.877296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ed1cd-bf24-4410-a017-cbc90f2eace9 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.878012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed1cd-bf24-4410-a017-cbc90f2eace9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:09.878316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed1cd-bf24-4410-a017-cbc90f2eace9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:09.880311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ed1cd-bf24-4410-a017-cbc90f2eace9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:09.888871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 287/563] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:09.890007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ecf8e-63f4-4446-a6c0-56a6d885a8cd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:09.890299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ecf8e-63f4-4446-a6c0-56a6d885a8cd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:09.890580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ecf8e-63f4-4446-a6c0-56a6d885a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:09.909528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-771ecf8e-63f4-4446-a6c0-56a6d885a8cd None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:09.910857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-771ecf8e-63f4-4446-a6c0-56a6d885a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:09.973689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9804d66-b986-4be4-b4ce-2ba51637d6e0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:09.973946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:09.984178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 288/564] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:09.984178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ecf8e-63f4-4446-a6c0-56a6d885a8cd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.015746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea30de-06be-4636-9a88-50bb87010f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.016390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea30de-06be-4636-9a88-50bb87010f53 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.016666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea30de-06be-4636-9a88-50bb87010f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.016939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea30de-06be-4636-9a88-50bb87010f53 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.017725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea30de-06be-4636-9a88-50bb87010f53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:10.018032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea30de-06be-4636-9a88-50bb87010f53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.019448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea30de-06be-4636-9a88-50bb87010f53 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.039524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 277/565] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 21:27:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:10.040989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea30de-06be-4636-9a88-50bb87010f53 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.075768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.100839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ecf8e-63f4-4446-a6c0-56a6d885a8cd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.135564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773e9f7-9a6e-448a-bd34-c91a23d11229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.136109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773e9f7-9a6e-448a-bd34-c91a23d11229 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.136443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773e9f7-9a6e-448a-bd34-c91a23d11229 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.136722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773e9f7-9a6e-448a-bd34-c91a23d11229 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.137472 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773e9f7-9a6e-448a-bd34-c91a23d11229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:10.137953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773e9f7-9a6e-448a-bd34-c91a23d11229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.139337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773e9f7-9a6e-448a-bd34-c91a23d11229 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.149675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea30de-06be-4636-9a88-50bb87010f53 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.157985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 289/566] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:10.157985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773e9f7-9a6e-448a-bd34-c91a23d11229 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.187247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba9c4-e4bf-47e7-9c00-9096c7d5d33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.187888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba9c4-e4bf-47e7-9c00-9096c7d5d33f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.188193 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba9c4-e4bf-47e7-9c00-9096c7d5d33f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.188470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fba9c4-e4bf-47e7-9c00-9096c7d5d33f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.199155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fba9c4-e4bf-47e7-9c00-9096c7d5d33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.200635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fba9c4-e4bf-47e7-9c00-9096c7d5d33f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.214620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d1fba9c4-e4bf-47e7-9c00-9096c7d5d33f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:10.216101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:10.217165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:10.218053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:10.218053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:10.218053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:10.218053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:10.218053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 278/567] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:10.218879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba9c4-e4bf-47e7-9c00-9096c7d5d33f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.265287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773e9f7-9a6e-448a-bd34-c91a23d11229 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.298586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaffc7-7f2b-47f1-9c06-057c48f9a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.299270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaffc7-7f2b-47f1-9c06-057c48f9a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.299551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaffc7-7f2b-47f1-9c06-057c48f9a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.299827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaffc7-7f2b-47f1-9c06-057c48f9a6e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.305434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.310965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaffc7-7f2b-47f1-9c06-057c48f9a6e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9ecaffc7-7f2b-47f1-9c06-057c48f9a6e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:10.316283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:10.317759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:10.318564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 290/568] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:10.319845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaffc7-7f2b-47f1-9c06-057c48f9a6e0 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.329828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fba9c4-e4bf-47e7-9c00-9096c7d5d33f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.366542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c203fc-8057-483a-8533-4c166935a415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.367184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c203fc-8057-483a-8533-4c166935a415 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.367465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c203fc-8057-483a-8533-4c166935a415 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.367756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c203fc-8057-483a-8533-4c166935a415 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.378957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c203fc-8057-483a-8533-4c166935a415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.380999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c203fc-8057-483a-8533-4c166935a415 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-23c203fc-8057-483a-8533-4c166935a415 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:10.397560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:10.398455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:10.404433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:10.404433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:10.404433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:10.404433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:10.404433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 279/569] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:10.404433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c203fc-8057-483a-8533-4c166935a415 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.426805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaffc7-7f2b-47f1-9c06-057c48f9a6e0 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.445691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.468234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595855c-649c-4cbf-8787-8bf74b756e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.468885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595855c-649c-4cbf-8787-8bf74b756e36 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.469166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595855c-649c-4cbf-8787-8bf74b756e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.469435 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595855c-649c-4cbf-8787-8bf74b756e36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.476510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595855c-649c-4cbf-8787-8bf74b756e36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.477968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595855c-649c-4cbf-8787-8bf74b756e36 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5595855c-649c-4cbf-8787-8bf74b756e36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:10.490557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:10.491425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 291/570] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:10.492942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595855c-649c-4cbf-8787-8bf74b756e36 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.515532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c203fc-8057-483a-8533-4c166935a415 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.550172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38d9f-c5e7-46e0-8b6a-43dffd496690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.550787 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38d9f-c5e7-46e0-8b6a-43dffd496690 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.551588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38d9f-c5e7-46e0-8b6a-43dffd496690 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.551844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38d9f-c5e7-46e0-8b6a-43dffd496690 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.552555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38d9f-c5e7-46e0-8b6a-43dffd496690 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:10.552853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38d9f-c5e7-46e0-8b6a-43dffd496690 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.554226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38d9f-c5e7-46e0-8b6a-43dffd496690 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.556689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.567957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 280/571] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:10.569243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38d9f-c5e7-46e0-8b6a-43dffd496690 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.605361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595855c-649c-4cbf-8787-8bf74b756e36 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.640603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4c15-98ea-4d31-81bb-d8c0d32ab49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.641214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4c15-98ea-4d31-81bb-d8c0d32ab49b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.641496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4c15-98ea-4d31-81bb-d8c0d32ab49b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.641776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e4c15-98ea-4d31-81bb-d8c0d32ab49b None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.642489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e4c15-98ea-4d31-81bb-d8c0d32ab49b None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:10.642789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e4c15-98ea-4d31-81bb-d8c0d32ab49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.645154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e4c15-98ea-4d31-81bb-d8c0d32ab49b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.656254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 292/572] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:10.656254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4c15-98ea-4d31-81bb-d8c0d32ab49b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.682862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38d9f-c5e7-46e0-8b6a-43dffd496690 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.693579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.718813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6b89c-1553-460e-9441-9b706f49ff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.719428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6b89c-1553-460e-9441-9b706f49ff83 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.719704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6b89c-1553-460e-9441-9b706f49ff83 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.719972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6b89c-1553-460e-9441-9b706f49ff83 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.720685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6b89c-1553-460e-9441-9b706f49ff83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:10.720994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6b89c-1553-460e-9441-9b706f49ff83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.722438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6b89c-1553-460e-9441-9b706f49ff83 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.734508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 281/573] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:10.735291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6b89c-1553-460e-9441-9b706f49ff83 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.764166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e4c15-98ea-4d31-81bb-d8c0d32ab49b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.789152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.797925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f43fd-24f4-40b5-a473-dcd189d92d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.798539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f43fd-24f4-40b5-a473-dcd189d92d91 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.798815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f43fd-24f4-40b5-a473-dcd189d92d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.799081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f43fd-24f4-40b5-a473-dcd189d92d91 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.799821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f43fd-24f4-40b5-a473-dcd189d92d91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:10.800123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f43fd-24f4-40b5-a473-dcd189d92d91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.802218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f43fd-24f4-40b5-a473-dcd189d92d91 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.813905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 293/574] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:10.814926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f43fd-24f4-40b5-a473-dcd189d92d91 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.835746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6b89c-1553-460e-9441-9b706f49ff83 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.868802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b8900-7f5c-455f-b526-2577919dba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.869484 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b8900-7f5c-455f-b526-2577919dba6d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.869720 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b8900-7f5c-455f-b526-2577919dba6d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.869991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b8900-7f5c-455f-b526-2577919dba6d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.877054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b8900-7f5c-455f-b526-2577919dba6d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.878461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b8900-7f5c-455f-b526-2577919dba6d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-346b8900-7f5c-455f-b526-2577919dba6d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:10.889474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:10.890542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:10.891471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 282/575] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:10.892049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81cc9c-6679-48f6-8cc7-c80e61460499 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.892049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81cc9c-6679-48f6-8cc7-c80e61460499 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.892466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81cc9c-6679-48f6-8cc7-c80e61460499 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.893521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 283/576] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:10.894214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81cc9c-6679-48f6-8cc7-c80e61460499 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.913247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.919606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f43fd-24f4-40b5-a473-dcd189d92d91 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.953434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4986a5-43e8-4ec5-aa65-abd5752ed1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.954069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4986a5-43e8-4ec5-aa65-abd5752ed1de None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.954353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4986a5-43e8-4ec5-aa65-abd5752ed1de None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.954629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4986a5-43e8-4ec5-aa65-abd5752ed1de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.964408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4986a5-43e8-4ec5-aa65-abd5752ed1de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.965845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4986a5-43e8-4ec5-aa65-abd5752ed1de None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-de4986a5-43e8-4ec5-aa65-abd5752ed1de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:10.980766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:10.981786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:10.982645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:10.982645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:10.982645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:10.982645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:10.982645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 294/577] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:10.982919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4986a5-43e8-4ec5-aa65-abd5752ed1de None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.996239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81cc9c-6679-48f6-8cc7-c80e61460499 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.012055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.031531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de6a61-c217-4a6f-b82c-553ed7b0ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.032184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de6a61-c217-4a6f-b82c-553ed7b0ca47 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.032467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de6a61-c217-4a6f-b82c-553ed7b0ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.032742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de6a61-c217-4a6f-b82c-553ed7b0ca47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.040017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de6a61-c217-4a6f-b82c-553ed7b0ca47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.041485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de6a61-c217-4a6f-b82c-553ed7b0ca47 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-55de6a61-c217-4a6f-b82c-553ed7b0ca47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:11.052493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:11.053556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:11.054441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:11.054441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:11.054441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:11.054441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:11.054441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:11.054441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:11.054441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:11.054441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:11.054441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 284/578] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:11.054923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de6a61-c217-4a6f-b82c-553ed7b0ca47 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.081934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4986a5-43e8-4ec5-aa65-abd5752ed1de None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.115635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad907f74-2075-4690-ad89-44da8190daed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.116288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907f74-2075-4690-ad89-44da8190daed None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.116569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907f74-2075-4690-ad89-44da8190daed None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.116840 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907f74-2075-4690-ad89-44da8190daed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.117625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad907f74-2075-4690-ad89-44da8190daed None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:11.117934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad907f74-2075-4690-ad89-44da8190daed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.119361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad907f74-2075-4690-ad89-44da8190daed None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.124621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 295/579] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/role_assignments?user.id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.125740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77bd7-2d2c-48e4-842e-f86c3e45b564 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.126026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77bd7-2d2c-48e4-842e-f86c3e45b564 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.126298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77bd7-2d2c-48e4-842e-f86c3e45b564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.145191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-09b77bd7-2d2c-48e4-842e-f86c3e45b564 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:11.147271 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-09b77bd7-2d2c-48e4-842e-f86c3e45b564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:11.159960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.163376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de6a61-c217-4a6f-b82c-553ed7b0ca47 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.202989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa49d0-7bb9-476a-8381-6d05c06bc73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.203624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa49d0-7bb9-476a-8381-6d05c06bc73d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.203904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa49d0-7bb9-476a-8381-6d05c06bc73d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.204201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa49d0-7bb9-476a-8381-6d05c06bc73d None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.205018 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa49d0-7bb9-476a-8381-6d05c06bc73d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:11.205331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa49d0-7bb9-476a-8381-6d05c06bc73d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.206784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa49d0-7bb9-476a-8381-6d05c06bc73d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.226981 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 285/580] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.227862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa49d0-7bb9-476a-8381-6d05c06bc73d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.239228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 296/581] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:11.240387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b77bd7-2d2c-48e4-842e-f86c3e45b564 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.271306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.342702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa49d0-7bb9-476a-8381-6d05c06bc73d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.350796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b77bd7-2d2c-48e4-842e-f86c3e45b564 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.377934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f87b-052e-48ba-9afe-3f0afdfd8108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.378559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f87b-052e-48ba-9afe-3f0afdfd8108 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.378842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f87b-052e-48ba-9afe-3f0afdfd8108 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.379614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d9f87b-052e-48ba-9afe-3f0afdfd8108 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.380351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f87b-052e-48ba-9afe-3f0afdfd8108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:11.380659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f87b-052e-48ba-9afe-3f0afdfd8108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.382028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d9f87b-052e-48ba-9afe-3f0afdfd8108 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.387741 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96581d48-9fba-430c-ae6a-05ed2c2be600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.388729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96581d48-9fba-430c-ae6a-05ed2c2be600 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.389188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96581d48-9fba-430c-ae6a-05ed2c2be600 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.389640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96581d48-9fba-430c-ae6a-05ed2c2be600 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.390689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96581d48-9fba-430c-ae6a-05ed2c2be600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:11.391173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96581d48-9fba-430c-ae6a-05ed2c2be600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.392861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96581d48-9fba-430c-ae6a-05ed2c2be600 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.393089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 286/582] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.393881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f87b-052e-48ba-9afe-3f0afdfd8108 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.409239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 297/583] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.410462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96581d48-9fba-430c-ae6a-05ed2c2be600 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.413089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.501746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.510066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d9f87b-052e-48ba-9afe-3f0afdfd8108 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.520628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96581d48-9fba-430c-ae6a-05ed2c2be600 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.546188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7a61b-803e-486c-947a-ac717d8f160c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.546831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7a61b-803e-486c-947a-ac717d8f160c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.547109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7a61b-803e-486c-947a-ac717d8f160c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.547383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7a61b-803e-486c-947a-ac717d8f160c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.558025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7a61b-803e-486c-947a-ac717d8f160c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.559454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7a61b-803e-486c-947a-ac717d8f160c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.562949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a273c8a-26c9-4ff5-a957-976ea901ba9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.563822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a273c8a-26c9-4ff5-a957-976ea901ba9b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.564325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a273c8a-26c9-4ff5-a957-976ea901ba9b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.564604 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a273c8a-26c9-4ff5-a957-976ea901ba9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f9a7a61b-803e-486c-947a-ac717d8f160c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:11.574164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:11.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:11.575884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:11.575884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:11.575884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:11.575884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:11.577447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a273c8a-26c9-4ff5-a957-976ea901ba9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:11.579958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 287/584] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:11.580802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7a61b-803e-486c-947a-ac717d8f160c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9a273c8a-26c9-4ff5-a957-976ea901ba9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:11.583389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:11.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:11.585138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 298/585] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:11.586417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a273c8a-26c9-4ff5-a957-976ea901ba9b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.649999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.687083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7a61b-803e-486c-947a-ac717d8f160c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.691461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a273c8a-26c9-4ff5-a957-976ea901ba9b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.723077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e085-8d46-46ac-b3bf-41358e55f829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.723713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e085-8d46-46ac-b3bf-41358e55f829 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.723993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e085-8d46-46ac-b3bf-41358e55f829 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.724296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618e085-8d46-46ac-b3bf-41358e55f829 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.729082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28804a72-0202-4945-ba03-30b3ab615be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.729819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28804a72-0202-4945-ba03-30b3ab615be2 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.730170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28804a72-0202-4945-ba03-30b3ab615be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.730511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28804a72-0202-4945-ba03-30b3ab615be2 None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/cab044fcd0dd449eafaccb81606d15ce/roles/78cbd44006c3419d916364b7251b1ae4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.731833 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618e085-8d46-46ac-b3bf-41358e55f829 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.733289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5618e085-8d46-46ac-b3bf-41358e55f829 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.746181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28804a72-0202-4945-ba03-30b3ab615be2 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=cab044fcd0dd449eafaccb81606d15ce, role_id=78cbd44006c3419d916364b7251b1ae4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5618e085-8d46-46ac-b3bf-41358e55f829 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:11.746339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:11.747413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:11.753247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 288/586] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:11.753973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28804a72-0202-4945-ba03-30b3ab615be2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.754136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e085-8d46-46ac-b3bf-41358e55f829 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.762842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.766012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 299/587] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:11 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/cab044fcd0dd449eafaccb81606d15ce/roles/78cbd44006c3419d916364b7251b1ae4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:11.776362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28804a72-0202-4945-ba03-30b3ab615be2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.894102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5618e085-8d46-46ac-b3bf-41358e55f829 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.929480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28804a72-0202-4945-ba03-30b3ab615be2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.946713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.952056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a89e9-8025-453d-9625-5ee5462d8fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.953652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a89e9-8025-453d-9625-5ee5462d8fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.953652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a89e9-8025-453d-9625-5ee5462d8fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.953652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a89e9-8025-453d-9625-5ee5462d8fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.954083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a89e9-8025-453d-9625-5ee5462d8fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:11.954385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a89e9-8025-453d-9625-5ee5462d8fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.955750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a89e9-8025-453d-9625-5ee5462d8fa2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.976262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 289/588] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.977418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a89e9-8025-453d-9625-5ee5462d8fa2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.979491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3252435-76a0-4da4-b9b2-c1089b0ed7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.980236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3252435-76a0-4da4-b9b2-c1089b0ed7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.980642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3252435-76a0-4da4-b9b2-c1089b0ed7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.981020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3252435-76a0-4da4-b9b2-c1089b0ed7e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.981787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3252435-76a0-4da4-b9b2-c1089b0ed7e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:11.982100 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3252435-76a0-4da4-b9b2-c1089b0ed7e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.983478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3252435-76a0-4da4-b9b2-c1089b0ed7e3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.992488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 300/589] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.993313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3252435-76a0-4da4-b9b2-c1089b0ed7e3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.063512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.101926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3252435-76a0-4da4-b9b2-c1089b0ed7e3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.110055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a89e9-8025-453d-9625-5ee5462d8fa2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.140575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682e23d-8574-4313-aa01-810c91647adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.141210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682e23d-8574-4313-aa01-810c91647adf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.141497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682e23d-8574-4313-aa01-810c91647adf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.141816 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682e23d-8574-4313-aa01-810c91647adf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.149502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682e23d-8574-4313-aa01-810c91647adf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.151138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682e23d-8574-4313-aa01-810c91647adf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.156596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6941b5-ead9-4884-95e4-5bbab7a9bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.157439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6941b5-ead9-4884-95e4-5bbab7a9bc38 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.157937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6941b5-ead9-4884-95e4-5bbab7a9bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.158408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6941b5-ead9-4884-95e4-5bbab7a9bc38 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.159668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6941b5-ead9-4884-95e4-5bbab7a9bc38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:12.160814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6941b5-ead9-4884-95e4-5bbab7a9bc38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.162488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6941b5-ead9-4884-95e4-5bbab7a9bc38 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e682e23d-8574-4313-aa01-810c91647adf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:12.165292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:12.166155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:12.167019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:12.167019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:12.167019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:12.167019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:12.167019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:12.167019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:12.167019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:12.167019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:12.167019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 301/590] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:12.167755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682e23d-8574-4313-aa01-810c91647adf None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.187803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 290/591] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:12.193023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6941b5-ead9-4884-95e4-5bbab7a9bc38 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.216513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.308359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6941b5-ead9-4884-95e4-5bbab7a9bc38 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.309240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682e23d-8574-4313-aa01-810c91647adf None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.336622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.345925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b3e9e-67a8-416f-b94f-9628d925f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.346679 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b3e9e-67a8-416f-b94f-9628d925f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.347060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b3e9e-67a8-416f-b94f-9628d925f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.348398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43b3e9e-67a8-416f-b94f-9628d925f1a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.349539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b3e9e-67a8-416f-b94f-9628d925f1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:12.350064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b3e9e-67a8-416f-b94f-9628d925f1a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.351583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43b3e9e-67a8-416f-b94f-9628d925f1a3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.353827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad38ec-c838-4ea5-b208-6598adeba623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.354989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad38ec-c838-4ea5-b208-6598adeba623 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.355418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad38ec-c838-4ea5-b208-6598adeba623 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.355846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fad38ec-c838-4ea5-b208-6598adeba623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.368217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 291/592] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:12.369245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b3e9e-67a8-416f-b94f-9628d925f1a3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.377387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad38ec-c838-4ea5-b208-6598adeba623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.379064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fad38ec-c838-4ea5-b208-6598adeba623 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4fad38ec-c838-4ea5-b208-6598adeba623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:12.395426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:12.396509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:12.397380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:12.397380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:12.397380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:12.397380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:12.398172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 302/593] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:12.399229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad38ec-c838-4ea5-b208-6598adeba623 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.475915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43b3e9e-67a8-416f-b94f-9628d925f1a3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.495596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.511540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fec912-1352-462e-9620-00d06900653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.512627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fec912-1352-462e-9620-00d06900653e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.513091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fec912-1352-462e-9620-00d06900653e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.513538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fec912-1352-462e-9620-00d06900653e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.513899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fad38ec-c838-4ea5-b208-6598adeba623 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.525568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fec912-1352-462e-9620-00d06900653e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.527269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fec912-1352-462e-9620-00d06900653e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-07fec912-1352-462e-9620-00d06900653e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:12.544682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:12.545587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:12.546442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:12.546442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:12.546442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:12.546442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:12.553213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 292/594] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:12.553213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fec912-1352-462e-9620-00d06900653e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.556889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8b52b-6bcd-401d-b45d-395aed729e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.558286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8b52b-6bcd-401d-b45d-395aed729e77 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.558286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8b52b-6bcd-401d-b45d-395aed729e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.558286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8b52b-6bcd-401d-b45d-395aed729e77 None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/124c246d00a841608a2bc4f5230f4eaf/roles/78cbd44006c3419d916364b7251b1ae4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.578669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8b52b-6bcd-401d-b45d-395aed729e77 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=124c246d00a841608a2bc4f5230f4eaf, role_id=78cbd44006c3419d916364b7251b1ae4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.580258 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8b52b-6bcd-401d-b45d-395aed729e77 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.593390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.600228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 303/595] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:12 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/124c246d00a841608a2bc4f5230f4eaf/roles/78cbd44006c3419d916364b7251b1ae4 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:12.601454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8b52b-6bcd-401d-b45d-395aed729e77 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.754182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fec912-1352-462e-9620-00d06900653e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.760604 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8b52b-6bcd-401d-b45d-395aed729e77 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.808021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943711-ddd2-407b-830d-137e0207a768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.809110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943711-ddd2-407b-830d-137e0207a768 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.809671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943711-ddd2-407b-830d-137e0207a768 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.810143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86943711-ddd2-407b-830d-137e0207a768 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.811091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943711-ddd2-407b-830d-137e0207a768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:12.811608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943711-ddd2-407b-830d-137e0207a768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.813804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86943711-ddd2-407b-830d-137e0207a768 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.823749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.825340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d0e65-a0f3-4c4d-8af3-746d699996e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.825958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0e65-a0f3-4c4d-8af3-746d699996e2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.827136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0e65-a0f3-4c4d-8af3-746d699996e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.827136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233d0e65-a0f3-4c4d-8af3-746d699996e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.827306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d0e65-a0f3-4c4d-8af3-746d699996e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:12.827510 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d0e65-a0f3-4c4d-8af3-746d699996e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.829174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233d0e65-a0f3-4c4d-8af3-746d699996e2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.834428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 304/596] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:12.838595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943711-ddd2-407b-830d-137e0207a768 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.846024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 293/597] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:12.851563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d0e65-a0f3-4c4d-8af3-746d699996e2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.965478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.969735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233d0e65-a0f3-4c4d-8af3-746d699996e2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.001674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86943711-ddd2-407b-830d-137e0207a768 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.007237 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607beca4-3318-4b8c-b183-304173714420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.008192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607beca4-3318-4b8c-b183-304173714420 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.008671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607beca4-3318-4b8c-b183-304173714420 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.009154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607beca4-3318-4b8c-b183-304173714420 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.025180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607beca4-3318-4b8c-b183-304173714420 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.026635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607beca4-3318-4b8c-b183-304173714420 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-607beca4-3318-4b8c-b183-304173714420 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:13.044181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:13.045102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:13.046284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 294/598] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:13.052803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607beca4-3318-4b8c-b183-304173714420 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.065505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3a2c5-52f2-4a76-bda0-cac894265cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.066151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3a2c5-52f2-4a76-bda0-cac894265cda None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.066933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3a2c5-52f2-4a76-bda0-cac894265cda None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.067213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3a2c5-52f2-4a76-bda0-cac894265cda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.078045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3a2c5-52f2-4a76-bda0-cac894265cda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.079490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3a2c5-52f2-4a76-bda0-cac894265cda None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9de3a2c5-52f2-4a76-bda0-cac894265cda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:13.099015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:13.101115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:13.103310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:13.103310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:13.103310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:13.103310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:13.103310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:13.103310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:13.103310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:13.103310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:13.103310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 305/599] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:13.110405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3a2c5-52f2-4a76-bda0-cac894265cda None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.201015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607beca4-3318-4b8c-b183-304173714420 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.201375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.236295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804a19c-a8c3-483c-81d1-019372a1cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.236992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804a19c-a8c3-483c-81d1-019372a1cd00 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.237272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804a19c-a8c3-483c-81d1-019372a1cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.237546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804a19c-a8c3-483c-81d1-019372a1cd00 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.238872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804a19c-a8c3-483c-81d1-019372a1cd00 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:13.239183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804a19c-a8c3-483c-81d1-019372a1cd00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.240656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804a19c-a8c3-483c-81d1-019372a1cd00 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.259265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 295/600] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:13.264921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804a19c-a8c3-483c-81d1-019372a1cd00 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.281647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3a2c5-52f2-4a76-bda0-cac894265cda None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.288196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.331697 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c9961-02dd-45ac-b722-e3388e6c9206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.332530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c9961-02dd-45ac-b722-e3388e6c9206 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.332816 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c9961-02dd-45ac-b722-e3388e6c9206 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.333095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c9961-02dd-45ac-b722-e3388e6c9206 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.333908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c9961-02dd-45ac-b722-e3388e6c9206 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:13.334224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c9961-02dd-45ac-b722-e3388e6c9206 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.335782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c9961-02dd-45ac-b722-e3388e6c9206 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.354349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 306/601] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:13.355734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aafaca-4a89-4e3b-aac6-b708d84cab28 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.356038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aafaca-4a89-4e3b-aac6-b708d84cab28 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.356354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aafaca-4a89-4e3b-aac6-b708d84cab28 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.357991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 307/602] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:13.358685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aafaca-4a89-4e3b-aac6-b708d84cab28 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.382705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804a19c-a8c3-483c-81d1-019372a1cd00 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.417902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a8e5e-35cc-4d11-9478-52ad090ea480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.418645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a8e5e-35cc-4d11-9478-52ad090ea480 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.418999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a8e5e-35cc-4d11-9478-52ad090ea480 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.419343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a8e5e-35cc-4d11-9478-52ad090ea480 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.430477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a8e5e-35cc-4d11-9478-52ad090ea480 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.431991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a8e5e-35cc-4d11-9478-52ad090ea480 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-cd7a8e5e-35cc-4d11-9478-52ad090ea480 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:13.447576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:13.448659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:13.449711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:13.449711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:13.449711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:13.449711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:13.456157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 296/603] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:13.456157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a53839-bcae-42ac-b3d1-b014c4758e8b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.456157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a53839-bcae-42ac-b3d1-b014c4758e8b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.456157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a53839-bcae-42ac-b3d1-b014c4758e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.471287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a7a53839-bcae-42ac-b3d1-b014c4758e8b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:13.472948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a7a53839-bcae-42ac-b3d1-b014c4758e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:13.476483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aafaca-4a89-4e3b-aac6-b708d84cab28 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.495704 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.517730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de29f1-2513-4259-84d8-814e3ef2a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.518821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de29f1-2513-4259-84d8-814e3ef2a1ab None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.519251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de29f1-2513-4259-84d8-814e3ef2a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.519717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de29f1-2513-4259-84d8-814e3ef2a1ab None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/4e3cd62eb975492aab4a136c0e9825a9/roles/78cbd44006c3419d916364b7251b1ae4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.537171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de29f1-2513-4259-84d8-814e3ef2a1ab None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=4e3cd62eb975492aab4a136c0e9825a9, role_id=78cbd44006c3419d916364b7251b1ae4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.537706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.540211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de29f1-2513-4259-84d8-814e3ef2a1ab None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.557058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 297/604] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:13.558317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a53839-bcae-42ac-b3d1-b014c4758e8b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.570906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 308/605] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:13 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/4e3cd62eb975492aab4a136c0e9825a9/roles/78cbd44006c3419d916364b7251b1ae4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:13.597235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de29f1-2513-4259-84d8-814e3ef2a1ab None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.731907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a53839-bcae-42ac-b3d1-b014c4758e8b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.773433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a800d6-92ad-4be7-92a8-16ad79df932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.774165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a800d6-92ad-4be7-92a8-16ad79df932e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.774517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a800d6-92ad-4be7-92a8-16ad79df932e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.775204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a800d6-92ad-4be7-92a8-16ad79df932e None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.775992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a800d6-92ad-4be7-92a8-16ad79df932e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:13.776389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a800d6-92ad-4be7-92a8-16ad79df932e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.777836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a800d6-92ad-4be7-92a8-16ad79df932e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.792667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 298/606] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:13.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a800d6-92ad-4be7-92a8-16ad79df932e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.802561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de29f1-2513-4259-84d8-814e3ef2a1ab None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.852007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d9262-9172-4391-b78d-321bc85b85e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.852704 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d9262-9172-4391-b78d-321bc85b85e6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.853215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d9262-9172-4391-b78d-321bc85b85e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.853388 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d9262-9172-4391-b78d-321bc85b85e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.867593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.874763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d9262-9172-4391-b78d-321bc85b85e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3d4d9262-9172-4391-b78d-321bc85b85e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:13.881163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:13.882203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:13.883132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 309/607] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:13.902869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d9262-9172-4391-b78d-321bc85b85e6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.934888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a800d6-92ad-4be7-92a8-16ad79df932e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.949998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.974560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabf45b-355e-45f7-8b4d-08a8a057fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.975597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabf45b-355e-45f7-8b4d-08a8a057fb8f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.976024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabf45b-355e-45f7-8b4d-08a8a057fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.976661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabf45b-355e-45f7-8b4d-08a8a057fb8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.984272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabf45b-355e-45f7-8b4d-08a8a057fb8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.986012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aabf45b-355e-45f7-8b4d-08a8a057fb8f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8aabf45b-355e-45f7-8b4d-08a8a057fb8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:13.999370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:14.000509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:14.001583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:14.001583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:14.001583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:14.001583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:14.001583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:14.001583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:14.001583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:14.001583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:14.003983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 299/608] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:14.005433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dee042-6dfd-4a89-a625-8b08abe0f694 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.005862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dee042-6dfd-4a89-a625-8b08abe0f694 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.006281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dee042-6dfd-4a89-a625-8b08abe0f694 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.008023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 300/609] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:14.013181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fcd3e-f1e5-42d6-965a-740e5b18c42b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.013621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fcd3e-f1e5-42d6-965a-740e5b18c42b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.014025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fcd3e-f1e5-42d6-965a-740e5b18c42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.034797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-068fcd3e-f1e5-42d6-965a-740e5b18c42b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:14.036882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-068fcd3e-f1e5-42d6-965a-740e5b18c42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:14.037238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d9262-9172-4391-b78d-321bc85b85e6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.076198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57821b4-328e-42ed-8e83-a9dc91d184d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.077243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57821b4-328e-42ed-8e83-a9dc91d184d2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.077761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57821b4-328e-42ed-8e83-a9dc91d184d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.078295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57821b4-328e-42ed-8e83-a9dc91d184d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.079170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57821b4-328e-42ed-8e83-a9dc91d184d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:14.079621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57821b4-328e-42ed-8e83-a9dc91d184d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:14.081229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57821b4-328e-42ed-8e83-a9dc91d184d2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:14.096084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 310/610] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:14.096084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57821b4-328e-42ed-8e83-a9dc91d184d2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.124560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 301/611] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:14.125701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fcd3e-f1e5-42d6-965a-740e5b18c42b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.183521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:14.227891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:14.244422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57821b4-328e-42ed-8e83-a9dc91d184d2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.255861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fcd3e-f1e5-42d6-965a-740e5b18c42b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.288808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10551b31-267b-43e2-9484-bde964a1a5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.289996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10551b31-267b-43e2-9484-bde964a1a5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.290427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10551b31-267b-43e2-9484-bde964a1a5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.291091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10551b31-267b-43e2-9484-bde964a1a5a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.292457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10551b31-267b-43e2-9484-bde964a1a5a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:14.293208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10551b31-267b-43e2-9484-bde964a1a5a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:14.295462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10551b31-267b-43e2-9484-bde964a1a5a6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:14.299996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b07a3-90a0-4461-9c68-cc800e15bacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.301461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b07a3-90a0-4461-9c68-cc800e15bacf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.302222 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b07a3-90a0-4461-9c68-cc800e15bacf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.302590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b07a3-90a0-4461-9c68-cc800e15bacf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.310509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 311/612] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:14.311574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10551b31-267b-43e2-9484-bde964a1a5a6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.316419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b07a3-90a0-4461-9c68-cc800e15bacf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:14.318011 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596b07a3-90a0-4461-9c68-cc800e15bacf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-596b07a3-90a0-4461-9c68-cc800e15bacf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:14.334809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:14.335876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:14.336960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:14.336960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:14.336960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:14.336960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:14.342298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 302/613] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:14.342298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b07a3-90a0-4461-9c68-cc800e15bacf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.447203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10551b31-267b-43e2-9484-bde964a1a5a6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.456388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:14.462889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596b07a3-90a0-4461-9c68-cc800e15bacf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.487189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bdc09-4b0a-4cf5-9b1e-55dcaae43569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.487949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bdc09-4b0a-4cf5-9b1e-55dcaae43569 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.488352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bdc09-4b0a-4cf5-9b1e-55dcaae43569 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.488713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bdc09-4b0a-4cf5-9b1e-55dcaae43569 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.500202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bdc09-4b0a-4cf5-9b1e-55dcaae43569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c05bdc09-4b0a-4cf5-9b1e-55dcaae43569 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:14.506653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:14.507558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:14.508422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:14.509888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e493e-db81-4f46-9f88-285b0d0c2f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.510750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e493e-db81-4f46-9f88-285b0d0c2f60 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.511189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e493e-db81-4f46-9f88-285b0d0c2f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.511620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e493e-db81-4f46-9f88-285b0d0c2f60 None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/24644cede7e149a6b3e5bd39b930017b/roles/78cbd44006c3419d916364b7251b1ae4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.512759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 312/614] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:14.513841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bdc09-4b0a-4cf5-9b1e-55dcaae43569 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.526484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:14.534790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e493e-db81-4f46-9f88-285b0d0c2f60 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=24644cede7e149a6b3e5bd39b930017b, role_id=78cbd44006c3419d916364b7251b1ae4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:14.537164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e493e-db81-4f46-9f88-285b0d0c2f60 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:14.554778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 303/615] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:14 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/24644cede7e149a6b3e5bd39b930017b/roles/78cbd44006c3419d916364b7251b1ae4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:14.560346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e493e-db81-4f46-9f88-285b0d0c2f60 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.726819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bdc09-4b0a-4cf5-9b1e-55dcaae43569 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.773093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e493e-db81-4f46-9f88-285b0d0c2f60 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.777993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc694d-19e0-4fb3-ae24-de3df4bc281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.778906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc694d-19e0-4fb3-ae24-de3df4bc281c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.779389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc694d-19e0-4fb3-ae24-de3df4bc281c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.780110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc694d-19e0-4fb3-ae24-de3df4bc281c None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.781573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc694d-19e0-4fb3-ae24-de3df4bc281c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:14.782102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc694d-19e0-4fb3-ae24-de3df4bc281c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:14.784154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc694d-19e0-4fb3-ae24-de3df4bc281c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:14.801420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 313/616] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:14.807289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc694d-19e0-4fb3-ae24-de3df4bc281c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.815069 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5ac5f-70dc-4ef0-b45e-0bcedf05d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.815994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5ac5f-70dc-4ef0-b45e-0bcedf05d8fa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.817170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5ac5f-70dc-4ef0-b45e-0bcedf05d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.817643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5ac5f-70dc-4ef0-b45e-0bcedf05d8fa None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.819378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5ac5f-70dc-4ef0-b45e-0bcedf05d8fa None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:14.819881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5ac5f-70dc-4ef0-b45e-0bcedf05d8fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:14.821491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5ac5f-70dc-4ef0-b45e-0bcedf05d8fa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:14.830780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 304/617] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:14.836674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5ac5f-70dc-4ef0-b45e-0bcedf05d8fa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.849698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:14.888503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:14.927617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc694d-19e0-4fb3-ae24-de3df4bc281c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.967446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac4460-b8e6-4ea9-adac-dd4b842891ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.967446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac4460-b8e6-4ea9-adac-dd4b842891ab None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.967446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac4460-b8e6-4ea9-adac-dd4b842891ab None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.967446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac4460-b8e6-4ea9-adac-dd4b842891ab None admin] PATH_INFO: `/v3/users/swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.974226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac4460-b8e6-4ea9-adac-dd4b842891ab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:14.975862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac4460-b8e6-4ea9-adac-dd4b842891ab None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c9ac4460-b8e6-4ea9-adac-dd4b842891ab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:14.987707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:14.989200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:14.990111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 314/618] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:15.000166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac4460-b8e6-4ea9-adac-dd4b842891ab None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.031274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5ac5f-70dc-4ef0-b45e-0bcedf05d8fa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.089437 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352eabf6-3fc9-41d9-8dd9-e91ecff8deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.090498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eabf6-3fc9-41d9-8dd9-e91ecff8deed None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.090976 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eabf6-3fc9-41d9-8dd9-e91ecff8deed None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.091466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352eabf6-3fc9-41d9-8dd9-e91ecff8deed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.102887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352eabf6-3fc9-41d9-8dd9-e91ecff8deed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.104587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352eabf6-3fc9-41d9-8dd9-e91ecff8deed None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.105326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac4460-b8e6-4ea9-adac-dd4b842891ab None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-352eabf6-3fc9-41d9-8dd9-e91ecff8deed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:15.119465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:15.120371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:15.121359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:15.121359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:15.121359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:15.121359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:15.127952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 305/619] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:15.129695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d91c68-a23f-4add-b8b4-9382f08cabfd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.130180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d91c68-a23f-4add-b8b4-9382f08cabfd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.130650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d91c68-a23f-4add-b8b4-9382f08cabfd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.133898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.136315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 306/620] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:15.137203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d91c68-a23f-4add-b8b4-9382f08cabfd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.144021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bb1f5-e3f4-4f4e-bc02-3756294db534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.144980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bb1f5-e3f4-4f4e-bc02-3756294db534 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.145483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bb1f5-e3f4-4f4e-bc02-3756294db534 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.145977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bb1f5-e3f4-4f4e-bc02-3756294db534 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.146979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bb1f5-e3f4-4f4e-bc02-3756294db534 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:15.147555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bb1f5-e3f4-4f4e-bc02-3756294db534 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.149362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098bb1f5-e3f4-4f4e-bc02-3756294db534 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.169965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 315/621] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:15.176979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a228f8-bfd3-4c3b-99ef-1d7197096480 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.177479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a228f8-bfd3-4c3b-99ef-1d7197096480 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.177940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a228f8-bfd3-4c3b-99ef-1d7197096480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.196755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-13a228f8-bfd3-4c3b-99ef-1d7197096480 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:15.198331 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-13a228f8-bfd3-4c3b-99ef-1d7197096480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:15.206454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.250761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d91c68-a23f-4add-b8b4-9382f08cabfd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.273286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 316/622] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:15.274788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a228f8-bfd3-4c3b-99ef-1d7197096480 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.302608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99237ec-b267-42f4-a405-28ad72f2f041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.303320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99237ec-b267-42f4-a405-28ad72f2f041 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.303716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99237ec-b267-42f4-a405-28ad72f2f041 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.304061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99237ec-b267-42f4-a405-28ad72f2f041 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.304924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99237ec-b267-42f4-a405-28ad72f2f041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:15.305391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99237ec-b267-42f4-a405-28ad72f2f041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.306970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99237ec-b267-42f4-a405-28ad72f2f041 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.332639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 307/623] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:15.333714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99237ec-b267-42f4-a405-28ad72f2f041 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.382533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a228f8-bfd3-4c3b-99ef-1d7197096480 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.405404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.430423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5da39d-c3d0-4b56-ac00-342daa91e485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.431916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5da39d-c3d0-4b56-ac00-342daa91e485 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.432407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5da39d-c3d0-4b56-ac00-342daa91e485 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.432877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5da39d-c3d0-4b56-ac00-342daa91e485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.444831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99237ec-b267-42f4-a405-28ad72f2f041 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.448157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5da39d-c3d0-4b56-ac00-342daa91e485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.449824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5da39d-c3d0-4b56-ac00-342daa91e485 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8f5da39d-c3d0-4b56-ac00-342daa91e485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:15.469361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:15.470391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:15.471261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:15.471261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:15.471261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:15.471261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:15.476503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 317/624] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:15.477447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5da39d-c3d0-4b56-ac00-342daa91e485 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.478833 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.494706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad38cd-0684-4f17-b965-fe0585f81b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.496022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad38cd-0684-4f17-b965-fe0585f81b86 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.496786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad38cd-0684-4f17-b965-fe0585f81b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.497268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad38cd-0684-4f17-b965-fe0585f81b86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.510927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad38cd-0684-4f17-b965-fe0585f81b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-24ad38cd-0684-4f17-b965-fe0585f81b86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:15.519077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:15.520583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:15.521390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:15.522779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 308/625] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:15.523792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad38cd-0684-4f17-b965-fe0585f81b86 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.591336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5da39d-c3d0-4b56-ac00-342daa91e485 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.628196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781f39-e5e0-4b53-b893-421821ad6ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.629068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781f39-e5e0-4b53-b893-421821ad6ffb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.629433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781f39-e5e0-4b53-b893-421821ad6ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.629776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4781f39-e5e0-4b53-b893-421821ad6ffb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.638145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4781f39-e5e0-4b53-b893-421821ad6ffb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.639795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4781f39-e5e0-4b53-b893-421821ad6ffb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e4781f39-e5e0-4b53-b893-421821ad6ffb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:15.652947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:15.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:15.655084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 318/626] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:15.655666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781f39-e5e0-4b53-b893-421821ad6ffb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.658613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad38cd-0684-4f17-b965-fe0585f81b86 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.691452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.702403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f09cb-5253-41af-a736-7ff2dad32564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.703297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f09cb-5253-41af-a736-7ff2dad32564 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.703798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f09cb-5253-41af-a736-7ff2dad32564 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.704345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f09cb-5253-41af-a736-7ff2dad32564 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.705256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f09cb-5253-41af-a736-7ff2dad32564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:15.705756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f09cb-5253-41af-a736-7ff2dad32564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.707894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f09cb-5253-41af-a736-7ff2dad32564 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.720875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 309/627] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:15.722021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f09cb-5253-41af-a736-7ff2dad32564 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.776125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.780782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4781f39-e5e0-4b53-b893-421821ad6ffb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.830296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595b2ab-343d-4936-907b-61b8c1d5f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.831080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595b2ab-343d-4936-907b-61b8c1d5f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.831460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595b2ab-343d-4936-907b-61b8c1d5f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.831832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b595b2ab-343d-4936-907b-61b8c1d5f5a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.833245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595b2ab-343d-4936-907b-61b8c1d5f5a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:15.833624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595b2ab-343d-4936-907b-61b8c1d5f5a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.835092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b595b2ab-343d-4936-907b-61b8c1d5f5a2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.843314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f09cb-5253-41af-a736-7ff2dad32564 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.844521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 319/628] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:15.846499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595b2ab-343d-4936-907b-61b8c1d5f5a2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.880774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae3b191-9745-4bfb-9efc-a573bc6f9860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.881411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b191-9745-4bfb-9efc-a573bc6f9860 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.881692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b191-9745-4bfb-9efc-a573bc6f9860 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.881966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3b191-9745-4bfb-9efc-a573bc6f9860 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.882785 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b191-9745-4bfb-9efc-a573bc6f9860 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:15.883093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b191-9745-4bfb-9efc-a573bc6f9860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.884599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae3b191-9745-4bfb-9efc-a573bc6f9860 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.905221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 310/629] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:15.906711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be87f8-d680-41a3-89dd-ecedaa1a8321 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.907145 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be87f8-d680-41a3-89dd-ecedaa1a8321 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.907562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be87f8-d680-41a3-89dd-ecedaa1a8321 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.912802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 311/630] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:15.913654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be87f8-d680-41a3-89dd-ecedaa1a8321 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.956728 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.969486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b595b2ab-343d-4936-907b-61b8c1d5f5a2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.011800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404a987-65bd-464a-addc-807cde220337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.012467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404a987-65bd-464a-addc-807cde220337 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.012751 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404a987-65bd-464a-addc-807cde220337 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.013087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404a987-65bd-464a-addc-807cde220337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.014336 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.019033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be87f8-d680-41a3-89dd-ecedaa1a8321 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.020631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404a987-65bd-464a-addc-807cde220337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.022079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404a987-65bd-464a-addc-807cde220337 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-1404a987-65bd-464a-addc-807cde220337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:16.034343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:16.035426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:16.036542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:16.036542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:16.036542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:16.036542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:16.036542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:16.036542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:16.036542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:16.036542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:16.036542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 320/631] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:16.037155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404a987-65bd-464a-addc-807cde220337 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.060230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37474d0-5baf-4f31-a6a3-ac96b10a7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.060870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37474d0-5baf-4f31-a6a3-ac96b10a7df0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.061162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37474d0-5baf-4f31-a6a3-ac96b10a7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.061435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37474d0-5baf-4f31-a6a3-ac96b10a7df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.071967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37474d0-5baf-4f31-a6a3-ac96b10a7df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.073441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37474d0-5baf-4f31-a6a3-ac96b10a7df0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a37474d0-5baf-4f31-a6a3-ac96b10a7df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:16.088898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:16.089767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:16.090848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:16.090848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:16.090848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:16.090848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:16.094670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 312/632] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:16.095842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7157cd5-b3fd-449f-99fe-93e7e39dd580 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.096147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7157cd5-b3fd-449f-99fe-93e7e39dd580 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.096427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7157cd5-b3fd-449f-99fe-93e7e39dd580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.114106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b7157cd5-b3fd-449f-99fe-93e7e39dd580 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:16.115300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b7157cd5-b3fd-449f-99fe-93e7e39dd580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:16.141660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404a987-65bd-464a-addc-807cde220337 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.179845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64409014-5149-42a4-8c81-fd703bc2fd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.181045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64409014-5149-42a4-8c81-fd703bc2fd5b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.181337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64409014-5149-42a4-8c81-fd703bc2fd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.181613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64409014-5149-42a4-8c81-fd703bc2fd5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.184392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 313/633] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:16.185236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7157cd5-b3fd-449f-99fe-93e7e39dd580 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.206759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.261211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64409014-5149-42a4-8c81-fd703bc2fd5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.262675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64409014-5149-42a4-8c81-fd703bc2fd5b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.274275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.295341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7157cd5-b3fd-449f-99fe-93e7e39dd580 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.331374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3ab59-4399-4250-b76a-8be927e0e758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.332031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3ab59-4399-4250-b76a-8be927e0e758 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.332380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3ab59-4399-4250-b76a-8be927e0e758 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.332654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3ab59-4399-4250-b76a-8be927e0e758 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.333397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3ab59-4399-4250-b76a-8be927e0e758 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:16.333711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3ab59-4399-4250-b76a-8be927e0e758 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.335150 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3ab59-4399-4250-b76a-8be927e0e758 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.347404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 314/634] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:16.348310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3ab59-4399-4250-b76a-8be927e0e758 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.377658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 321/635] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:16.378327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64409014-5149-42a4-8c81-fd703bc2fd5b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.431228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.457678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3ab59-4399-4250-b76a-8be927e0e758 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.485972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64409014-5149-42a4-8c81-fd703bc2fd5b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.495035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a9457-5f5c-4e68-b9b1-d4836a8bbf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.495657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a9457-5f5c-4e68-b9b1-d4836a8bbf65 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.495937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a9457-5f5c-4e68-b9b1-d4836a8bbf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.496243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a9457-5f5c-4e68-b9b1-d4836a8bbf65 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.496921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a9457-5f5c-4e68-b9b1-d4836a8bbf65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:16.497223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a9457-5f5c-4e68-b9b1-d4836a8bbf65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.498589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a9457-5f5c-4e68-b9b1-d4836a8bbf65 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.515543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 315/636] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:16.515543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a9457-5f5c-4e68-b9b1-d4836a8bbf65 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.515543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.528695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef054-fcb4-42d3-b85a-36a2bcb6cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.529349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef054-fcb4-42d3-b85a-36a2bcb6cac8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.529885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef054-fcb4-42d3-b85a-36a2bcb6cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.530185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef054-fcb4-42d3-b85a-36a2bcb6cac8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.541208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ef054-fcb4-42d3-b85a-36a2bcb6cac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-424ef054-fcb4-42d3-b85a-36a2bcb6cac8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:16.546121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:16.547029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:16.547841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 322/637] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:16.548555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef054-fcb4-42d3-b85a-36a2bcb6cac8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.627352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a9457-5f5c-4e68-b9b1-d4836a8bbf65 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.663299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef054-fcb4-42d3-b85a-36a2bcb6cac8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.669216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7397-ba28-46cf-b1be-d3e7ffc93bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.669900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7397-ba28-46cf-b1be-d3e7ffc93bfa None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.670180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7397-ba28-46cf-b1be-d3e7ffc93bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.670452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e7397-ba28-46cf-b1be-d3e7ffc93bfa None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/fa5d7ef1e1cd4185b3f0eb8215bf0dd6/roles/78cbd44006c3419d916364b7251b1ae4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.674198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.691381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7397-ba28-46cf-b1be-d3e7ffc93bfa None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6, role_id=78cbd44006c3419d916364b7251b1ae4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.693040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e7397-ba28-46cf-b1be-d3e7ffc93bfa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.704783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1705c-7df8-4ae1-b4d5-3224df1a0afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.705486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1705c-7df8-4ae1-b4d5-3224df1a0afd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.705819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1705c-7df8-4ae1-b4d5-3224df1a0afd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.706147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1705c-7df8-4ae1-b4d5-3224df1a0afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.716372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 316/638] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:16 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/fa5d7ef1e1cd4185b3f0eb8215bf0dd6/roles/78cbd44006c3419d916364b7251b1ae4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:16.716372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7397-ba28-46cf-b1be-d3e7ffc93bfa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.730065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1705c-7df8-4ae1-b4d5-3224df1a0afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.732398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1705c-7df8-4ae1-b4d5-3224df1a0afd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e3a1705c-7df8-4ae1-b4d5-3224df1a0afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:16.750650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:16.751591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:16.753127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:16.753127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:16.753127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:16.753127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:16.753127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 323/639] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:16.753127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1705c-7df8-4ae1-b4d5-3224df1a0afd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.802662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.861920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e7397-ba28-46cf-b1be-d3e7ffc93bfa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.875675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1705c-7df8-4ae1-b4d5-3224df1a0afd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.903014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b5e8e-a600-4de1-bd01-0cedbdd44825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.903589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b5e8e-a600-4de1-bd01-0cedbdd44825 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.903873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b5e8e-a600-4de1-bd01-0cedbdd44825 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.904157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b5e8e-a600-4de1-bd01-0cedbdd44825 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.911797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b5e8e-a600-4de1-bd01-0cedbdd44825 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.913258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b5e8e-a600-4de1-bd01-0cedbdd44825 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.917727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b7f62-4db3-45e5-883c-e03eb4ab7469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.920456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b7f62-4db3-45e5-883c-e03eb4ab7469 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.920943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b7f62-4db3-45e5-883c-e03eb4ab7469 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.921405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b7f62-4db3-45e5-883c-e03eb4ab7469 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.922334 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b7f62-4db3-45e5-883c-e03eb4ab7469 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:16.922820 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b7f62-4db3-45e5-883c-e03eb4ab7469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.924484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4b7f62-4db3-45e5-883c-e03eb4ab7469 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-196b5e8e-a600-4de1-bd01-0cedbdd44825 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:16.925519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:16.926494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 317/640] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:16.927713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b5e8e-a600-4de1-bd01-0cedbdd44825 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.940959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 324/641] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:16.945751 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9b457-77e9-4563-9e32-5c632bc23e11 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.946210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9b457-77e9-4563-9e32-5c632bc23e11 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.946634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9b457-77e9-4563-9e32-5c632bc23e11 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.948543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 325/642] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:16.949478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9b457-77e9-4563-9e32-5c632bc23e11 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.978762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.040873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b5e8e-a600-4de1-bd01-0cedbdd44825 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.054681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.073094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9b457-77e9-4563-9e32-5c632bc23e11 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.077987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2078c-445d-4e16-8e5f-9cda9b0d59bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.078708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2078c-445d-4e16-8e5f-9cda9b0d59bb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.079090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2078c-445d-4e16-8e5f-9cda9b0d59bb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.079459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2078c-445d-4e16-8e5f-9cda9b0d59bb None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.080291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2078c-445d-4e16-8e5f-9cda9b0d59bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:17.080703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2078c-445d-4e16-8e5f-9cda9b0d59bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.082189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced2078c-445d-4e16-8e5f-9cda9b0d59bb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.094573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 318/643] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:17.095528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2078c-445d-4e16-8e5f-9cda9b0d59bb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.112782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd688d-bc60-4452-83b3-fc5b84a56a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.113953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd688d-bc60-4452-83b3-fc5b84a56a82 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.114236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd688d-bc60-4452-83b3-fc5b84a56a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.114511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd688d-bc60-4452-83b3-fc5b84a56a82 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.115311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd688d-bc60-4452-83b3-fc5b84a56a82 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:17.115617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd688d-bc60-4452-83b3-fc5b84a56a82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.117201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd688d-bc60-4452-83b3-fc5b84a56a82 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.136397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 326/644] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:17.137616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a265190-503c-4905-a61d-9790d82e9657 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.137901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a265190-503c-4905-a61d-9790d82e9657 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.138180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a265190-503c-4905-a61d-9790d82e9657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.157148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3a265190-503c-4905-a61d-9790d82e9657 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:17.158261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3a265190-503c-4905-a61d-9790d82e9657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:17.203925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2078c-445d-4e16-8e5f-9cda9b0d59bb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.229124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 327/645] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:17.230306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a265190-503c-4905-a61d-9790d82e9657 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.249460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.251247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bba00a-69e9-4408-9974-77313aa01d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.252378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bba00a-69e9-4408-9974-77313aa01d7a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.252818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bba00a-69e9-4408-9974-77313aa01d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.253138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bba00a-69e9-4408-9974-77313aa01d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.265545 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bba00a-69e9-4408-9974-77313aa01d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.267042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bba00a-69e9-4408-9974-77313aa01d7a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-09bba00a-69e9-4408-9974-77313aa01d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:17.285782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:17.286740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:17.287759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:17.287759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:17.287759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:17.287759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:17.287759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 319/646] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:17.287759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bba00a-69e9-4408-9974-77313aa01d7a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.314748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.347382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a265190-503c-4905-a61d-9790d82e9657 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.382441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcadc8-5537-4024-ae5d-937686411326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.383146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcadc8-5537-4024-ae5d-937686411326 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.383424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcadc8-5537-4024-ae5d-937686411326 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.383697 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcadc8-5537-4024-ae5d-937686411326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.390624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcadc8-5537-4024-ae5d-937686411326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.392063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcadc8-5537-4024-ae5d-937686411326 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.393239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bba00a-69e9-4408-9974-77313aa01d7a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-d6dcadc8-5537-4024-ae5d-937686411326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:17.403778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:17.405246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:17.406204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:17.406204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:17.406204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:17.406204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:17.406204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:17.406204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:17.406204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:17.406204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:17.406204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 328/647] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:17.411060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcadc8-5537-4024-ae5d-937686411326 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.433853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896075d9-ea36-4215-9a8a-af2900e07da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.434480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896075d9-ea36-4215-9a8a-af2900e07da1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.434813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896075d9-ea36-4215-9a8a-af2900e07da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.435088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896075d9-ea36-4215-9a8a-af2900e07da1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.488944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.511998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896075d9-ea36-4215-9a8a-af2900e07da1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.514050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896075d9-ea36-4215-9a8a-af2900e07da1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.522698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcadc8-5537-4024-ae5d-937686411326 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.539345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.561291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491aa07-4c0d-4787-8526-c63dae529506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.562200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491aa07-4c0d-4787-8526-c63dae529506 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.562575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491aa07-4c0d-4787-8526-c63dae529506 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.563315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491aa07-4c0d-4787-8526-c63dae529506 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.576486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491aa07-4c0d-4787-8526-c63dae529506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-1491aa07-4c0d-4787-8526-c63dae529506 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:17.583663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:17.584769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:17.585693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:17.592490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 329/648] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:17.592490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491aa07-4c0d-4787-8526-c63dae529506 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.620854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 320/649] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:17.620854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896075d9-ea36-4215-9a8a-af2900e07da1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.704099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491aa07-4c0d-4787-8526-c63dae529506 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.723119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896075d9-ea36-4215-9a8a-af2900e07da1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.740202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.746062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5cdea-b3f7-4062-8de7-73634ceb859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.746808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5cdea-b3f7-4062-8de7-73634ceb859d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.747192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5cdea-b3f7-4062-8de7-73634ceb859d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.747560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5cdea-b3f7-4062-8de7-73634ceb859d None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.748281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.748466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5cdea-b3f7-4062-8de7-73634ceb859d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:17.748848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5cdea-b3f7-4062-8de7-73634ceb859d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.750368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5cdea-b3f7-4062-8de7-73634ceb859d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.760710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a3825-2cae-4b9f-94b1-57800f05ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.761403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3825-2cae-4b9f-94b1-57800f05ee9e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.761755 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3825-2cae-4b9f-94b1-57800f05ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.762099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a3825-2cae-4b9f-94b1-57800f05ee9e None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.767192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 330/650] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:17.767324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3825-2cae-4b9f-94b1-57800f05ee9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:17.767324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3825-2cae-4b9f-94b1-57800f05ee9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.767503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5cdea-b3f7-4062-8de7-73634ceb859d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.767594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a3825-2cae-4b9f-94b1-57800f05ee9e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.784429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 321/651] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:17.784429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a3825-2cae-4b9f-94b1-57800f05ee9e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.882818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5cdea-b3f7-4062-8de7-73634ceb859d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.892217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a3825-2cae-4b9f-94b1-57800f05ee9e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.918938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d689be-fa20-4ee9-bb3b-b58b94a844f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.919556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d689be-fa20-4ee9-bb3b-b58b94a844f9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.919846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d689be-fa20-4ee9-bb3b-b58b94a844f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.920111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d689be-fa20-4ee9-bb3b-b58b94a844f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.920850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d689be-fa20-4ee9-bb3b-b58b94a844f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:17.921153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d689be-fa20-4ee9-bb3b-b58b94a844f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.922518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d689be-fa20-4ee9-bb3b-b58b94a844f9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.928449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3d630-387a-4145-80cc-edb27563789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.929089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3d630-387a-4145-80cc-edb27563789f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.929368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3d630-387a-4145-80cc-edb27563789f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.929639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3d630-387a-4145-80cc-edb27563789f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.935572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 331/652] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:17.935572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d689be-fa20-4ee9-bb3b-b58b94a844f9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.940968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3d630-387a-4145-80cc-edb27563789f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.942609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3d630-387a-4145-80cc-edb27563789f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9ca3d630-387a-4145-80cc-edb27563789f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:17.956677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:17.958044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:17.963982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:17.963982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:17.963982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:17.963982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:17.963982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 322/653] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:17.963982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3d630-387a-4145-80cc-edb27563789f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.997610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.999378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.051610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d689be-fa20-4ee9-bb3b-b58b94a844f9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.064601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3d630-387a-4145-80cc-edb27563789f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.087922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0e7f0-ab8c-4b8f-9afb-7a8648d8d08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.088594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0e7f0-ab8c-4b8f-9afb-7a8648d8d08a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.088995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0e7f0-ab8c-4b8f-9afb-7a8648d8d08a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.089272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0e7f0-ab8c-4b8f-9afb-7a8648d8d08a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.097039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b85343-5bbf-43a9-835f-9c9eb5e036ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.097259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0e7f0-ab8c-4b8f-9afb-7a8648d8d08a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.098187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b85343-5bbf-43a9-835f-9c9eb5e036ed None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.098467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b85343-5bbf-43a9-835f-9c9eb5e036ed None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.098737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b85343-5bbf-43a9-835f-9c9eb5e036ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.099268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0e7f0-ab8c-4b8f-9afb-7a8648d8d08a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.099512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b85343-5bbf-43a9-835f-9c9eb5e036ed None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=cab044fcd0dd449eafaccb81606d15ce) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:18.099819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b85343-5bbf-43a9-835f-9c9eb5e036ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.101250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b85343-5bbf-43a9-835f-9c9eb5e036ed None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.113745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 323/654] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/role_assignments?user.id=cab044fcd0dd449eafaccb81606d15ce&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:18.113745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b85343-5bbf-43a9-835f-9c9eb5e036ed None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4fa0e7f0-ab8c-4b8f-9afb-7a8648d8d08a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:18.114016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:18.114881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 332/655] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:18.115783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0e7f0-ab8c-4b8f-9afb-7a8648d8d08a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.231922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.235353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b85343-5bbf-43a9-835f-9c9eb5e036ed None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.245482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0e7f0-ab8c-4b8f-9afb-7a8648d8d08a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.264173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.278922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422d293-0b20-47f4-a982-d28379957d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.279825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422d293-0b20-47f4-a982-d28379957d50 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.280112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422d293-0b20-47f4-a982-d28379957d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.280410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422d293-0b20-47f4-a982-d28379957d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.295126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422d293-0b20-47f4-a982-d28379957d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.296680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422d293-0b20-47f4-a982-d28379957d50 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.301149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f2f6b-430a-495c-acc4-e1320a114b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.302222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f2f6b-430a-495c-acc4-e1320a114b62 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.302774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f2f6b-430a-495c-acc4-e1320a114b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.303253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f2f6b-430a-495c-acc4-e1320a114b62 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.304511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f2f6b-430a-495c-acc4-e1320a114b62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:18.305188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f2f6b-430a-495c-acc4-e1320a114b62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.306865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f2f6b-430a-495c-acc4-e1320a114b62 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f422d293-0b20-47f4-a982-d28379957d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:18.313891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:18.314795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:18.316792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:18.316792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:18.316792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:18.316792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:18.316792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 324/656] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:18.316792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422d293-0b20-47f4-a982-d28379957d50 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.327364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 333/657] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:18.327955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f2f6b-430a-495c-acc4-e1320a114b62 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.441870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422d293-0b20-47f4-a982-d28379957d50 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.467700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f2f6b-430a-495c-acc4-e1320a114b62 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.482583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01c156-3ae9-4baf-b5f4-0fc2401217fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.483268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01c156-3ae9-4baf-b5f4-0fc2401217fb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.484114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01c156-3ae9-4baf-b5f4-0fc2401217fb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.484516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01c156-3ae9-4baf-b5f4-0fc2401217fb None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.485815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01c156-3ae9-4baf-b5f4-0fc2401217fb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:18.486229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01c156-3ae9-4baf-b5f4-0fc2401217fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.488974 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01c156-3ae9-4baf-b5f4-0fc2401217fb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.505980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4031-b87f-40aa-83d2-4841748caec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.506826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4031-b87f-40aa-83d2-4841748caec6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.507274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4031-b87f-40aa-83d2-4841748caec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.507689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff4031-b87f-40aa-83d2-4841748caec6 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.508562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff4031-b87f-40aa-83d2-4841748caec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:18.509010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff4031-b87f-40aa-83d2-4841748caec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.510529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff4031-b87f-40aa-83d2-4841748caec6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.516174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 325/658] 10.222.0.57 () {56 vars in 1137 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:18.516174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01c156-3ae9-4baf-b5f4-0fc2401217fb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.527590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.527888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 334/659] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:18.529095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4031-b87f-40aa-83d2-4841748caec6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.574791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.633273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01c156-3ae9-4baf-b5f4-0fc2401217fb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.659387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff4031-b87f-40aa-83d2-4841748caec6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.679247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb5aab-d742-4f45-b2cf-eb4dc15d66bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.679900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb5aab-d742-4f45-b2cf-eb4dc15d66bb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.683946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb5aab-d742-4f45-b2cf-eb4dc15d66bb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.683946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb5aab-d742-4f45-b2cf-eb4dc15d66bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.692378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb5aab-d742-4f45-b2cf-eb4dc15d66bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.696600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb5aab-d742-4f45-b2cf-eb4dc15d66bb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.706323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365168a-e6e9-4d79-bcf6-131e33c99238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.707288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365168a-e6e9-4d79-bcf6-131e33c99238 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.707814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365168a-e6e9-4d79-bcf6-131e33c99238 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.708325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365168a-e6e9-4d79-bcf6-131e33c99238 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-26fb5aab-d742-4f45-b2cf-eb4dc15d66bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:18.714030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:18.714962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:18.715891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:18.715891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:18.715891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:18.715891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:18.715891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:18.715891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:18.715891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:18.715891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:18.715891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 326/660] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:18.716878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb5aab-d742-4f45-b2cf-eb4dc15d66bb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.794039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365168a-e6e9-4d79-bcf6-131e33c99238 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.795551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365168a-e6e9-4d79-bcf6-131e33c99238 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.801917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.832110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.844044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb5aab-d742-4f45-b2cf-eb4dc15d66bb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.880757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8877be-e947-4001-90c0-e3d1060188cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.881393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8877be-e947-4001-90c0-e3d1060188cd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.881672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8877be-e947-4001-90c0-e3d1060188cd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.882188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8877be-e947-4001-90c0-e3d1060188cd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.889175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8877be-e947-4001-90c0-e3d1060188cd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.890600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8877be-e947-4001-90c0-e3d1060188cd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 335/661] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:18.902077 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365168a-e6e9-4d79-bcf6-131e33c99238 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-de8877be-e947-4001-90c0-e3d1060188cd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:18.907356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:18.908592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 327/662] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:18.910532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3a9e4-8630-49e1-8500-c15b68bca7c2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.911456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3a9e4-8630-49e1-8500-c15b68bca7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.911456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad3a9e4-8630-49e1-8500-c15b68bca7c2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.912389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 328/663] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:18.912903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3a9e4-8630-49e1-8500-c15b68bca7c2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.009734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365168a-e6e9-4d79-bcf6-131e33c99238 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.016452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad3a9e4-8630-49e1-8500-c15b68bca7c2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.044509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54238149-187d-4a49-86aa-37640492d3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.045062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54238149-187d-4a49-86aa-37640492d3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.045345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54238149-187d-4a49-86aa-37640492d3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.045623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54238149-187d-4a49-86aa-37640492d3f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.046378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54238149-187d-4a49-86aa-37640492d3f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:19.046688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54238149-187d-4a49-86aa-37640492d3f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.047535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.048170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54238149-187d-4a49-86aa-37640492d3f6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.050196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.056484 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a626f-d6e7-42b9-8be9-bc81f142ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.058017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a626f-d6e7-42b9-8be9-bc81f142ff31 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.058300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a626f-d6e7-42b9-8be9-bc81f142ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.058572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a626f-d6e7-42b9-8be9-bc81f142ff31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.067147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 336/664] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.067147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54238149-187d-4a49-86aa-37640492d3f6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.071778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a626f-d6e7-42b9-8be9-bc81f142ff31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.073269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a626f-d6e7-42b9-8be9-bc81f142ff31 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c63a626f-d6e7-42b9-8be9-bc81f142ff31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:19.088996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:19.089873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:19.091532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:19.091532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:19.091532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:19.091532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:19.091532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 329/665] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:19.091532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13416-5cd8-49d8-8cf3-02d87cb01eaa None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.091889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13416-5cd8-49d8-8cf3-02d87cb01eaa None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.091966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e13416-5cd8-49d8-8cf3-02d87cb01eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.109999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b6e13416-5cd8-49d8-8cf3-02d87cb01eaa None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:19.111178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b6e13416-5cd8-49d8-8cf3-02d87cb01eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:19.178631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54238149-187d-4a49-86aa-37640492d3f6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.180926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 330/666] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:19.181907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e13416-5cd8-49d8-8cf3-02d87cb01eaa None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.225945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf70c9-277c-4d4f-b6f2-90331352790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.226565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf70c9-277c-4d4f-b6f2-90331352790a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.226846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf70c9-277c-4d4f-b6f2-90331352790a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.227119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf70c9-277c-4d4f-b6f2-90331352790a None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.227915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf70c9-277c-4d4f-b6f2-90331352790a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:19.228254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf70c9-277c-4d4f-b6f2-90331352790a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.229744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf70c9-277c-4d4f-b6f2-90331352790a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.252095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 337/667] 10.222.0.57 () {56 vars in 1139 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.252095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf70c9-277c-4d4f-b6f2-90331352790a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.294101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e13416-5cd8-49d8-8cf3-02d87cb01eaa None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.303957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.310041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.337061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a1d48-ca97-4f33-b0c1-08e46b4d03ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.337749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a1d48-ca97-4f33-b0c1-08e46b4d03ff None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.337963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a1d48-ca97-4f33-b0c1-08e46b4d03ff None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.338235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a1d48-ca97-4f33-b0c1-08e46b4d03ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.339129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a1d48-ca97-4f33-b0c1-08e46b4d03ff None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=124c246d00a841608a2bc4f5230f4eaf) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:19.339330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a1d48-ca97-4f33-b0c1-08e46b4d03ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.340795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a1d48-ca97-4f33-b0c1-08e46b4d03ff None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.347192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 331/668] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/role_assignments?user.id=124c246d00a841608a2bc4f5230f4eaf&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.348574 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a1d48-ca97-4f33-b0c1-08e46b4d03ff None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.374777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf70c9-277c-4d4f-b6f2-90331352790a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.418298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9707c81-77c9-4805-9f9f-6c0659cd2fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.419232 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9707c81-77c9-4805-9f9f-6c0659cd2fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.419678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9707c81-77c9-4805-9f9f-6c0659cd2fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.420106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9707c81-77c9-4805-9f9f-6c0659cd2fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.421291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9707c81-77c9-4805-9f9f-6c0659cd2fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:19.422247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9707c81-77c9-4805-9f9f-6c0659cd2fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.423364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9707c81-77c9-4805-9f9f-6c0659cd2fc6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.436721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 338/669] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.437619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9707c81-77c9-4805-9f9f-6c0659cd2fc6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.487765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a1d48-ca97-4f33-b0c1-08e46b4d03ff None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.536093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98736d6-c5b5-4445-aa12-32e822c8a796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.536886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98736d6-c5b5-4445-aa12-32e822c8a796 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.537243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98736d6-c5b5-4445-aa12-32e822c8a796 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.537522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98736d6-c5b5-4445-aa12-32e822c8a796 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.549532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98736d6-c5b5-4445-aa12-32e822c8a796 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:19.552553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9707c81-77c9-4805-9f9f-6c0659cd2fc6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d98736d6-c5b5-4445-aa12-32e822c8a796 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:19.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:19.556694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:19.557538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:19.558911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 332/670] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:19.558911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98736d6-c5b5-4445-aa12-32e822c8a796 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.565781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.596220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf29c5-caf4-4c07-a2e4-76473092624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.596961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf29c5-caf4-4c07-a2e4-76473092624d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.597964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf29c5-caf4-4c07-a2e4-76473092624d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.598258 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdf29c5-caf4-4c07-a2e4-76473092624d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.602918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.672609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf29c5-caf4-4c07-a2e4-76473092624d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.674418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdf29c5-caf4-4c07-a2e4-76473092624d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.678244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98736d6-c5b5-4445-aa12-32e822c8a796 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.726340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce5027-8c4d-40ac-a859-fb0cea75c77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.727009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce5027-8c4d-40ac-a859-fb0cea75c77f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.727284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce5027-8c4d-40ac-a859-fb0cea75c77f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.727552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce5027-8c4d-40ac-a859-fb0cea75c77f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.734991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce5027-8c4d-40ac-a859-fb0cea75c77f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.736937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce5027-8c4d-40ac-a859-fb0cea75c77f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c5ce5027-8c4d-40ac-a859-fb0cea75c77f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:19.749270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:19.750187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:19.751071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:19.751071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:19.751071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:19.751071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:19.751071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:19.751071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:19.751071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:19.751071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:19.751071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 333/671] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:19.752000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce5027-8c4d-40ac-a859-fb0cea75c77f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.787448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 339/672] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:19.788411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf29c5-caf4-4c07-a2e4-76473092624d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.820753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.855175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce5027-8c4d-40ac-a859-fb0cea75c77f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.864508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.891011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdf29c5-caf4-4c07-a2e4-76473092624d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.891557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aff7e-c936-4907-97c6-6c35ee7c8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.892220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aff7e-c936-4907-97c6-6c35ee7c8ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.892513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aff7e-c936-4907-97c6-6c35ee7c8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.892789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48aff7e-c936-4907-97c6-6c35ee7c8ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.893511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aff7e-c936-4907-97c6-6c35ee7c8ea1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:19.893819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aff7e-c936-4907-97c6-6c35ee7c8ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.895842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48aff7e-c936-4907-97c6-6c35ee7c8ea1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.905392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 334/673] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.906370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aff7e-c936-4907-97c6-6c35ee7c8ea1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.927952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec80db3-71a2-46fc-9344-b4c0786b1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.928767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec80db3-71a2-46fc-9344-b4c0786b1ffa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.929151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec80db3-71a2-46fc-9344-b4c0786b1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.929528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec80db3-71a2-46fc-9344-b4c0786b1ffa None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.930384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec80db3-71a2-46fc-9344-b4c0786b1ffa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:19.930790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec80db3-71a2-46fc-9344-b4c0786b1ffa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.932371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec80db3-71a2-46fc-9344-b4c0786b1ffa None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.948391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 340/674] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.949386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec80db3-71a2-46fc-9344-b4c0786b1ffa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.011544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48aff7e-c936-4907-97c6-6c35ee7c8ea1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.040606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.046919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d96b0-bf89-4f62-afeb-94951b23d056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.047567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d96b0-bf89-4f62-afeb-94951b23d056 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.047853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d96b0-bf89-4f62-afeb-94951b23d056 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.048147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d96b0-bf89-4f62-afeb-94951b23d056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.059095 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d96b0-bf89-4f62-afeb-94951b23d056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.060577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d96b0-bf89-4f62-afeb-94951b23d056 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.062257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec80db3-71a2-46fc-9344-b4c0786b1ffa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c07d96b0-bf89-4f62-afeb-94951b23d056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:20.075806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:20.076731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:20.077583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:20.077583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:20.077583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:20.077583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:20.077583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 335/675] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:20.078273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d96b0-bf89-4f62-afeb-94951b23d056 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.094453 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.113869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393c01f-f89d-4204-8275-de5297c76a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.115432 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393c01f-f89d-4204-8275-de5297c76a02 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.116037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393c01f-f89d-4204-8275-de5297c76a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.116613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393c01f-f89d-4204-8275-de5297c76a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.131565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393c01f-f89d-4204-8275-de5297c76a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.134071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4393c01f-f89d-4204-8275-de5297c76a02 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4393c01f-f89d-4204-8275-de5297c76a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:20.154401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:20.155746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:20.156870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:20.156870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:20.156870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:20.156870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:20.159943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 341/676] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:20.160971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393c01f-f89d-4204-8275-de5297c76a02 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.190724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d96b0-bf89-4f62-afeb-94951b23d056 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.229095 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2060a8-227e-4940-ada2-4197bc69f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.230002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2060a8-227e-4940-ada2-4197bc69f44c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.230399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2060a8-227e-4940-ada2-4197bc69f44c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.230738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2060a8-227e-4940-ada2-4197bc69f44c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.231612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2060a8-227e-4940-ada2-4197bc69f44c None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=4e3cd62eb975492aab4a136c0e9825a9) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:20.231989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2060a8-227e-4940-ada2-4197bc69f44c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.233512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2060a8-227e-4940-ada2-4197bc69f44c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.248520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 336/677] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/role_assignments?user.id=4e3cd62eb975492aab4a136c0e9825a9&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:20.249624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2060a8-227e-4940-ada2-4197bc69f44c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.289092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393c01f-f89d-4204-8275-de5297c76a02 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.318985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.334269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bb91a-4286-4e7b-a359-48136017e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.335213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bb91a-4286-4e7b-a359-48136017e611 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.336358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bb91a-4286-4e7b-a359-48136017e611 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.336862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bb91a-4286-4e7b-a359-48136017e611 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.337793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bb91a-4286-4e7b-a359-48136017e611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:20.338349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bb91a-4286-4e7b-a359-48136017e611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.340324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bb91a-4286-4e7b-a359-48136017e611 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.356533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 342/678] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:20.370060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bb91a-4286-4e7b-a359-48136017e611 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.423241 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.457987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2060a8-227e-4940-ada2-4197bc69f44c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.507421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7dadf1-89c4-423f-9da9-5528f8886fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.508042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dadf1-89c4-423f-9da9-5528f8886fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.508353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dadf1-89c4-423f-9da9-5528f8886fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.508630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7dadf1-89c4-423f-9da9-5528f8886fb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.509767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dadf1-89c4-423f-9da9-5528f8886fb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:20.510344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dadf1-89c4-423f-9da9-5528f8886fb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.511917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7dadf1-89c4-423f-9da9-5528f8886fb5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.524178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bb91a-4286-4e7b-a359-48136017e611 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.526183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 337/679] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:20.527427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ab3a-c9f8-4a1e-993b-fccf86d721ab None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.527713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ab3a-c9f8-4a1e-993b-fccf86d721ab None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.527984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ab3a-c9f8-4a1e-993b-fccf86d721ab None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.529872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 338/680] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:20.537481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8ab3a-c9f8-4a1e-993b-fccf86d721ab None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.569259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a3467-8c89-48dd-9dc5-ebf5fbef1c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.569789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a3467-8c89-48dd-9dc5-ebf5fbef1c6f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.569789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a3467-8c89-48dd-9dc5-ebf5fbef1c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.569931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a3467-8c89-48dd-9dc5-ebf5fbef1c6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.578239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a3467-8c89-48dd-9dc5-ebf5fbef1c6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.579713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a3467-8c89-48dd-9dc5-ebf5fbef1c6f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-2b5a3467-8c89-48dd-9dc5-ebf5fbef1c6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:20.591710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:20.592637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:20.593511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:20.593511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:20.593511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:20.593511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:20.593511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:20.593511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:20.593511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:20.593511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:20.593511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 343/681] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:20.594428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc696c-9803-4cb8-8d46-edc5944e1b8b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.597948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc696c-9803-4cb8-8d46-edc5944e1b8b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.597948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc696c-9803-4cb8-8d46-edc5944e1b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.614636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-84cc696c-9803-4cb8-8d46-edc5944e1b8b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:20.615833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-84cc696c-9803-4cb8-8d46-edc5944e1b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:20.659276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8ab3a-c9f8-4a1e-993b-fccf86d721ab None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.667725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.706758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 344/682] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:20.707615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc696c-9803-4cb8-8d46-edc5944e1b8b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.720938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348d661-05f4-41be-a5ee-070920e0d21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.721586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348d661-05f4-41be-a5ee-070920e0d21f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.721862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348d661-05f4-41be-a5ee-070920e0d21f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.722126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348d661-05f4-41be-a5ee-070920e0d21f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.725827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.732365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348d661-05f4-41be-a5ee-070920e0d21f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.734178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348d661-05f4-41be-a5ee-070920e0d21f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8348d661-05f4-41be-a5ee-070920e0d21f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:20.760606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:20.761663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:20.762901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 339/683] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:20.763500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348d661-05f4-41be-a5ee-070920e0d21f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.868164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc696c-9803-4cb8-8d46-edc5944e1b8b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.884779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348d661-05f4-41be-a5ee-070920e0d21f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.913270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeea096-c4bc-494b-83f3-3e4ef91caa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.914256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeea096-c4bc-494b-83f3-3e4ef91caa07 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.915012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeea096-c4bc-494b-83f3-3e4ef91caa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.915713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeea096-c4bc-494b-83f3-3e4ef91caa07 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.916649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeea096-c4bc-494b-83f3-3e4ef91caa07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:20.917263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeea096-c4bc-494b-83f3-3e4ef91caa07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.919577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeea096-c4bc-494b-83f3-3e4ef91caa07 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.923162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b0d9b-fa3d-4ad9-9968-6b8cd15146f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.923694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b0d9b-fa3d-4ad9-9968-6b8cd15146f3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.924069 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b0d9b-fa3d-4ad9-9968-6b8cd15146f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.924464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b0d9b-fa3d-4ad9-9968-6b8cd15146f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.934924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 345/684] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:20.935510 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b0d9b-fa3d-4ad9-9968-6b8cd15146f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:20.936314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeea096-c4bc-494b-83f3-3e4ef91caa07 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-471b0d9b-fa3d-4ad9-9968-6b8cd15146f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:20.943278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:20.944451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:20.945405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:20.951059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 340/685] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:20.952001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b0d9b-fa3d-4ad9-9968-6b8cd15146f3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.986445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.017184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.062390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeea096-c4bc-494b-83f3-3e4ef91caa07 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.081174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b0d9b-fa3d-4ad9-9968-6b8cd15146f3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.100099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7026b4-7c45-42a6-af2d-1c1cdc0318be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.100841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7026b4-7c45-42a6-af2d-1c1cdc0318be None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.101194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7026b4-7c45-42a6-af2d-1c1cdc0318be None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.101558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7026b4-7c45-42a6-af2d-1c1cdc0318be None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.103028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7026b4-7c45-42a6-af2d-1c1cdc0318be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:21.103502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7026b4-7c45-42a6-af2d-1c1cdc0318be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.105363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7026b4-7c45-42a6-af2d-1c1cdc0318be None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.126579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a297ff-c24e-4d7d-9080-64584bf44833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.127500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a297ff-c24e-4d7d-9080-64584bf44833 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.127991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a297ff-c24e-4d7d-9080-64584bf44833 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.129097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a297ff-c24e-4d7d-9080-64584bf44833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.130129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a297ff-c24e-4d7d-9080-64584bf44833 None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=24644cede7e149a6b3e5bd39b930017b) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:21.130644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a297ff-c24e-4d7d-9080-64584bf44833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.132432 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 346/686] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:21.132644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a297ff-c24e-4d7d-9080-64584bf44833 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.133405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7026b4-7c45-42a6-af2d-1c1cdc0318be None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.146380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 341/687] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/role_assignments?user.id=24644cede7e149a6b3e5bd39b930017b&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:21.147672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a297ff-c24e-4d7d-9080-64584bf44833 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.314145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.331084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7026b4-7c45-42a6-af2d-1c1cdc0318be None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.338176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a297ff-c24e-4d7d-9080-64584bf44833 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.370517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.373272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b0173-fa97-473a-af4f-314b330ddd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.374078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b0173-fa97-473a-af4f-314b330ddd30 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.374489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b0173-fa97-473a-af4f-314b330ddd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.374924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b0173-fa97-473a-af4f-314b330ddd30 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.380229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b0173-fa97-473a-af4f-314b330ddd30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:21.380229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b0173-fa97-473a-af4f-314b330ddd30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.380229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b0173-fa97-473a-af4f-314b330ddd30 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.391079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 347/688] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:21.394841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c800f-bac6-4db9-851f-8b7abd5af44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.395753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c800f-bac6-4db9-851f-8b7abd5af44c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.396342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c800f-bac6-4db9-851f-8b7abd5af44c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.397329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c800f-bac6-4db9-851f-8b7abd5af44c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.397518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b0173-fa97-473a-af4f-314b330ddd30 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.473858 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c800f-bac6-4db9-851f-8b7abd5af44c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.476265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5c800f-bac6-4db9-851f-8b7abd5af44c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.509349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b0173-fa97-473a-af4f-314b330ddd30 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.548173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f00f5-f998-49fd-b6db-0bd6ab842c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.549420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f00f5-f998-49fd-b6db-0bd6ab842c65 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.551261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f00f5-f998-49fd-b6db-0bd6ab842c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.551727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f00f5-f998-49fd-b6db-0bd6ab842c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.565576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f00f5-f998-49fd-b6db-0bd6ab842c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.568670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f00f5-f998-49fd-b6db-0bd6ab842c65 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.586031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 342/689] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-a49f00f5-f998-49fd-b6db-0bd6ab842c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:21.587834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:21.588949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:21.589793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:21.589793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:21.589793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:21.589793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:21.591457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c800f-bac6-4db9-851f-8b7abd5af44c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.592071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 348/690] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:21.598790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f00f5-f998-49fd-b6db-0bd6ab842c65 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.613921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.618447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.729886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5c800f-bac6-4db9-851f-8b7abd5af44c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.730910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f00f5-f998-49fd-b6db-0bd6ab842c65 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.769682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e136e61-8206-4094-aec4-85fcdba214a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.770320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e136e61-8206-4094-aec4-85fcdba214a5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.770602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e136e61-8206-4094-aec4-85fcdba214a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.770875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e136e61-8206-4094-aec4-85fcdba214a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.772423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ce4c1-0be0-4214-b657-6d9fcd470536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.773491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ce4c1-0be0-4214-b657-6d9fcd470536 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.773967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ce4c1-0be0-4214-b657-6d9fcd470536 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.774431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ce4c1-0be0-4214-b657-6d9fcd470536 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.775307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ce4c1-0be0-4214-b657-6d9fcd470536 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:21.775791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ce4c1-0be0-4214-b657-6d9fcd470536 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.777468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ce4c1-0be0-4214-b657-6d9fcd470536 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.781516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e136e61-8206-4094-aec4-85fcdba214a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.782945 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e136e61-8206-4094-aec4-85fcdba214a5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.791516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 349/691] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:21.793192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbedf7-7c8a-4014-bad8-4ea6316c3b33 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.793662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbedf7-7c8a-4014-bad8-4ea6316c3b33 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.794115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbedf7-7c8a-4014-bad8-4ea6316c3b33 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.795973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 350/692] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:21.796894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbedf7-7c8a-4014-bad8-4ea6316c3b33 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1e136e61-8206-4094-aec4-85fcdba214a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:21.803398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:21.804392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:21.805607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:21.805607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:21.805607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:21.805607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:21.805607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 343/693] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:21.806060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fb16c-1924-4b40-92bf-4ad1d777d5e3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.810928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fb16c-1924-4b40-92bf-4ad1d777d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.811225 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fb16c-1924-4b40-92bf-4ad1d777d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.829625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-321fb16c-1924-4b40-92bf-4ad1d777d5e3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:21.830813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-321fb16c-1924-4b40-92bf-4ad1d777d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:21.894594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.901859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.904371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 344/694] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:21.905492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fb16c-1924-4b40-92bf-4ad1d777d5e3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.921178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbedf7-7c8a-4014-bad8-4ea6316c3b33 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.961706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d8ec-38e2-48fc-8c2b-12fc5cb46208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.962364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d8ec-38e2-48fc-8c2b-12fc5cb46208 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.962647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d8ec-38e2-48fc-8c2b-12fc5cb46208 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.962924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c388d8ec-38e2-48fc-8c2b-12fc5cb46208 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.972868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388d8ec-38e2-48fc-8c2b-12fc5cb46208 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.974330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c388d8ec-38e2-48fc-8c2b-12fc5cb46208 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-c388d8ec-38e2-48fc-8c2b-12fc5cb46208 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:21.986742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:21.987645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:21.989231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:21.993032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 351/695] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:21.993880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d8ec-38e2-48fc-8c2b-12fc5cb46208 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.024269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fb16c-1924-4b40-92bf-4ad1d777d5e3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.065020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff61fa-36cb-406f-b62d-22426a5cf4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.065630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff61fa-36cb-406f-b62d-22426a5cf4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.065939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff61fa-36cb-406f-b62d-22426a5cf4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.066214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff61fa-36cb-406f-b62d-22426a5cf4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.066904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff61fa-36cb-406f-b62d-22426a5cf4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:22.067207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff61fa-36cb-406f-b62d-22426a5cf4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.068605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff61fa-36cb-406f-b62d-22426a5cf4d5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.084594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 345/696] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:22.085487 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff61fa-36cb-406f-b62d-22426a5cf4d5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.123745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c388d8ec-38e2-48fc-8c2b-12fc5cb46208 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.151149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.160556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.170542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51199bc-bded-4a78-a952-5009adf3ce13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.171009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51199bc-bded-4a78-a952-5009adf3ce13 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.171290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51199bc-bded-4a78-a952-5009adf3ce13 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.171562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51199bc-bded-4a78-a952-5009adf3ce13 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.172216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51199bc-bded-4a78-a952-5009adf3ce13 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.173597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51199bc-bded-4a78-a952-5009adf3ce13 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-a51199bc-bded-4a78-a952-5009adf3ce13 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:22.185705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:22.186762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:27:22.187641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:22.191721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 352/697] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:22.192583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51199bc-bded-4a78-a952-5009adf3ce13 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.215396 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff61fa-36cb-406f-b62d-22426a5cf4d5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.251949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db969f-defe-4cbf-bea9-3a70b348de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.252518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db969f-defe-4cbf-bea9-3a70b348de88 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.252870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db969f-defe-4cbf-bea9-3a70b348de88 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.253148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db969f-defe-4cbf-bea9-3a70b348de88 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.253985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db969f-defe-4cbf-bea9-3a70b348de88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:22.254293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db969f-defe-4cbf-bea9-3a70b348de88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.255713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db969f-defe-4cbf-bea9-3a70b348de88 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.274282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 346/698] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:22.275412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db969f-defe-4cbf-bea9-3a70b348de88 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.334609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51199bc-bded-4a78-a952-5009adf3ce13 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.384862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db969f-defe-4cbf-bea9-3a70b348de88 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.386756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a136b-0055-45e0-99b7-f9725c3bbb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.388543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a136b-0055-45e0-99b7-f9725c3bbb95 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.389063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a136b-0055-45e0-99b7-f9725c3bbb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.389535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a136b-0055-45e0-99b7-f9725c3bbb95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.399373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a136b-0055-45e0-99b7-f9725c3bbb95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.401948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a136b-0055-45e0-99b7-f9725c3bbb95 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.403894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-482a136b-0055-45e0-99b7-f9725c3bbb95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:22.417711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:22.418609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:22.419477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:22.419477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:22.419477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:22.419477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:22.419477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:22.419477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:22.419477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:22.419477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:22.419477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 353/699] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:22.419951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a136b-0055-45e0-99b7-f9725c3bbb95 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.431700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3eb0-dd27-4fc1-b2bd-9d01c79f2e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.432664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3eb0-dd27-4fc1-b2bd-9d01c79f2e21 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.433138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3eb0-dd27-4fc1-b2bd-9d01c79f2e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.434098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b3eb0-dd27-4fc1-b2bd-9d01c79f2e21 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.434963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b3eb0-dd27-4fc1-b2bd-9d01c79f2e21 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:22.435441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b3eb0-dd27-4fc1-b2bd-9d01c79f2e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.437439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b3eb0-dd27-4fc1-b2bd-9d01c79f2e21 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.444499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 347/700] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:22.445551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3eb0-dd27-4fc1-b2bd-9d01c79f2e21 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.487685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.550709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a136b-0055-45e0-99b7-f9725c3bbb95 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.566579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b3eb0-dd27-4fc1-b2bd-9d01c79f2e21 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.586005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c358b-fcce-45d3-80d2-52ae3f64cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.587562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c358b-fcce-45d3-80d2-52ae3f64cb90 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.587858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c358b-fcce-45d3-80d2-52ae3f64cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.588445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c358b-fcce-45d3-80d2-52ae3f64cb90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.601932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb028d8-b269-4629-ba81-230c397b3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.602645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb028d8-b269-4629-ba81-230c397b3128 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.602894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb028d8-b269-4629-ba81-230c397b3128 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.603092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb028d8-b269-4629-ba81-230c397b3128 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.603832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb028d8-b269-4629-ba81-230c397b3128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:22.604155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb028d8-b269-4629-ba81-230c397b3128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.605574 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb028d8-b269-4629-ba81-230c397b3128 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.618555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 348/701] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:22.619729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb028d8-b269-4629-ba81-230c397b3128 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.666103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.668864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c358b-fcce-45d3-80d2-52ae3f64cb90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.671352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c358b-fcce-45d3-80d2-52ae3f64cb90 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.723901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.726397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb028d8-b269-4629-ba81-230c397b3128 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.763235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e5c31-c229-47b1-911c-7a7ca5d5d2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.763849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e5c31-c229-47b1-911c-7a7ca5d5d2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.764124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e5c31-c229-47b1-911c-7a7ca5d5d2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.764418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e5c31-c229-47b1-911c-7a7ca5d5d2b9 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.765080 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e5c31-c229-47b1-911c-7a7ca5d5d2b9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:22.765381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e5c31-c229-47b1-911c-7a7ca5d5d2b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.766719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e5c31-c229-47b1-911c-7a7ca5d5d2b9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.779768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 349/702] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:22.779768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaf136-54bd-4f80-850a-e625daac621a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.779768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaf136-54bd-4f80-850a-e625daac621a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.779768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaf136-54bd-4f80-850a-e625daac621a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.779768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 350/703] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:22.779768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdaf136-54bd-4f80-850a-e625daac621a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.795294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 354/704] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:22.796706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f151a-e68d-4b66-a782-754a6b67c702 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.797005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f151a-e68d-4b66-a782-754a6b67c702 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.797292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f151a-e68d-4b66-a782-754a6b67c702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.817309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-854f151a-e68d-4b66-a782-754a6b67c702 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:22.818734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-854f151a-e68d-4b66-a782-754a6b67c702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:22.898746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 355/705] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:22.899763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f151a-e68d-4b66-a782-754a6b67c702 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.911485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdaf136-54bd-4f80-850a-e625daac621a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.919145 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.950926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27360394-fe3c-472a-ba36-0528cfe6296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.951766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27360394-fe3c-472a-ba36-0528cfe6296b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.952047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27360394-fe3c-472a-ba36-0528cfe6296b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.952346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27360394-fe3c-472a-ba36-0528cfe6296b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.953140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27360394-fe3c-472a-ba36-0528cfe6296b None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:22.953448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27360394-fe3c-472a-ba36-0528cfe6296b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.955118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27360394-fe3c-472a-ba36-0528cfe6296b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.962651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 351/706] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/role_assignments?user.id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:22.963512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27360394-fe3c-472a-ba36-0528cfe6296b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.026511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.050030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f151a-e68d-4b66-a782-754a6b67c702 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.087116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27360394-fe3c-472a-ba36-0528cfe6296b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.108563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3707ab-d863-4165-9af7-465d6357fa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.109222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3707ab-d863-4165-9af7-465d6357fa0b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.109504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3707ab-d863-4165-9af7-465d6357fa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.109776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3707ab-d863-4165-9af7-465d6357fa0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.124822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b747-73f6-4dab-927b-092fd4b04b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.125495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b747-73f6-4dab-927b-092fd4b04b3e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.126089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b747-73f6-4dab-927b-092fd4b04b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.126089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b747-73f6-4dab-927b-092fd4b04b3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.139928 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3707ab-d863-4165-9af7-465d6357fa0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.141507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3707ab-d863-4165-9af7-465d6357fa0b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.149163 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b747-73f6-4dab-927b-092fd4b04b3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.150628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b747-73f6-4dab-927b-092fd4b04b3e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8e3707ab-d863-4165-9af7-465d6357fa0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:23.167360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:23.168301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:23.169154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:23.169154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:23.169154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:23.169154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:23.169154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 356/707] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c3f0b747-73f6-4dab-927b-092fd4b04b3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:23.172474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:23.173310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:23.174185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:23.174185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:23.174185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:23.174185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:23.174185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 352/708] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:23.179436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3707ab-d863-4165-9af7-465d6357fa0b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.180684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b747-73f6-4dab-927b-092fd4b04b3e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.216594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.299052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3707ab-d863-4165-9af7-465d6357fa0b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.302360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b747-73f6-4dab-927b-092fd4b04b3e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.334992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fbbbc-3d8a-4c12-b237-49648705cadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.335638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fbbbc-3d8a-4c12-b237-49648705cadb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.335920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fbbbc-3d8a-4c12-b237-49648705cadb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.336235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6fbbbc-3d8a-4c12-b237-49648705cadb None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.336937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fbbbc-3d8a-4c12-b237-49648705cadb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:23.337297 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fbbbc-3d8a-4c12-b237-49648705cadb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.338710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6fbbbc-3d8a-4c12-b237-49648705cadb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.340588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302afe86-4025-4a02-93d6-82772e4c7200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.341465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302afe86-4025-4a02-93d6-82772e4c7200 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.341953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302afe86-4025-4a02-93d6-82772e4c7200 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.343216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302afe86-4025-4a02-93d6-82772e4c7200 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.344213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302afe86-4025-4a02-93d6-82772e4c7200 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:23.344718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302afe86-4025-4a02-93d6-82772e4c7200 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.346296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302afe86-4025-4a02-93d6-82772e4c7200 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.352523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.356341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 357/709] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:23.359716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fbbbc-3d8a-4c12-b237-49648705cadb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.368814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 353/710] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:23.374653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302afe86-4025-4a02-93d6-82772e4c7200 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.476481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.491817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6fbbbc-3d8a-4c12-b237-49648705cadb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.497852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302afe86-4025-4a02-93d6-82772e4c7200 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.530209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79b1c8-dde9-46f1-8f20-4eacd9d798a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.531103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79b1c8-dde9-46f1-8f20-4eacd9d798a9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.531597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79b1c8-dde9-46f1-8f20-4eacd9d798a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.532054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79b1c8-dde9-46f1-8f20-4eacd9d798a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.536639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92a8e6-5701-45d8-99ff-cfcf9c5c8820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.537340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92a8e6-5701-45d8-99ff-cfcf9c5c8820 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.537692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92a8e6-5701-45d8-99ff-cfcf9c5c8820 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.538034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92a8e6-5701-45d8-99ff-cfcf9c5c8820 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.538787 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92a8e6-5701-45d8-99ff-cfcf9c5c8820 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.540323 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92a8e6-5701-45d8-99ff-cfcf9c5c8820 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.541853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79b1c8-dde9-46f1-8f20-4eacd9d798a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.543470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79b1c8-dde9-46f1-8f20-4eacd9d798a9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-2d79b1c8-dde9-46f1-8f20-4eacd9d798a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:23.556235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:23.557146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:23.558008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:23.558008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:23.558008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:23.558008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:23.558008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:23.558008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:23.558008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:23.558008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:23.559851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 358/711] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:23.569715 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 354/712] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:23 2022] POST /identity/v3/users => generated 254 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:27:23.570154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79b1c8-dde9-46f1-8f20-4eacd9d798a9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.607341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52ddfb-395d-41e0-b523-95290bddf365 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.607872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52ddfb-395d-41e0-b523-95290bddf365 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.607872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52ddfb-395d-41e0-b523-95290bddf365 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.609544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 355/713] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:23.615676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691934-5677-49d0-b4d1-2e7f5471e767 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.615975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691934-5677-49d0-b4d1-2e7f5471e767 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.616260 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691934-5677-49d0-b4d1-2e7f5471e767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.635631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0a691934-5677-49d0-b4d1-2e7f5471e767 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:23.636932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0a691934-5677-49d0-b4d1-2e7f5471e767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:23.671440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.752248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 356/714] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:23.779625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a691934-5677-49d0-b4d1-2e7f5471e767 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.862599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.905609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a691934-5677-49d0-b4d1-2e7f5471e767 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.913797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79b1c8-dde9-46f1-8f20-4eacd9d798a9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.944049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d45199-a3cc-421f-90a8-cf573c12eb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.945031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d45199-a3cc-421f-90a8-cf573c12eb0a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.945494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d45199-a3cc-421f-90a8-cf573c12eb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.945971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d45199-a3cc-421f-90a8-cf573c12eb0a None admin] PATH_INFO: `/v3/services/network` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.946811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d45199-a3cc-421f-90a8-cf573c12eb0a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.948422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d45199-a3cc-421f-90a8-cf573c12eb0a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.949208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa9229-ef4f-490c-988d-a560a97baf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.949998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa9229-ef4f-490c-988d-a560a97baf84 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.950423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa9229-ef4f-490c-988d-a560a97baf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.950899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa9229-ef4f-490c-988d-a560a97baf84 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.951858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa9229-ef4f-490c-988d-a560a97baf84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:23.952421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa9229-ef4f-490c-988d-a560a97baf84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.954044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa9229-ef4f-490c-988d-a560a97baf84 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-48d45199-a3cc-421f-90a8-cf573c12eb0a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:23.960470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:23.961460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:23.962262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 357/715] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:23.967758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d45199-a3cc-421f-90a8-cf573c12eb0a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.970488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 359/716] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:23.976972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa9229-ef4f-490c-988d-a560a97baf84 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.081313 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d45199-a3cc-421f-90a8-cf573c12eb0a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.082437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa9229-ef4f-490c-988d-a560a97baf84 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.095757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:24.113102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:24.119119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a341072-f906-42a5-8105-d7a8d50f3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.119581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580d9c-8e3b-4fa0-ac38-f1f51749dd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.119748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a341072-f906-42a5-8105-d7a8d50f3746 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.120068 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a341072-f906-42a5-8105-d7a8d50f3746 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.120381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a341072-f906-42a5-8105-d7a8d50f3746 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.120568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580d9c-8e3b-4fa0-ac38-f1f51749dd2c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.120986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580d9c-8e3b-4fa0-ac38-f1f51749dd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.121113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a341072-f906-42a5-8105-d7a8d50f3746 None admin] RBAC: Adding query filter params (name=network) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:24.121391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a341072-f906-42a5-8105-d7a8d50f3746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.121708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd580d9c-8e3b-4fa0-ac38-f1f51749dd2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.122375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd580d9c-8e3b-4fa0-ac38-f1f51749dd2c None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=cab044fcd0dd449eafaccb81606d15ce) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:24.122780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd580d9c-8e3b-4fa0-ac38-f1f51749dd2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.122880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a341072-f906-42a5-8105-d7a8d50f3746 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.124565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd580d9c-8e3b-4fa0-ac38-f1f51749dd2c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.131624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 360/717] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/role_assignments?user.id=cab044fcd0dd449eafaccb81606d15ce&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:24.134520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 358/718] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:24.137499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580d9c-8e3b-4fa0-ac38-f1f51749dd2c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.344616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd580d9c-8e3b-4fa0-ac38-f1f51749dd2c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.381134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3263a-c837-4e5a-a99d-ba04af338b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.381678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3263a-c837-4e5a-a99d-ba04af338b23 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.381956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3263a-c837-4e5a-a99d-ba04af338b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.382229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3263a-c837-4e5a-a99d-ba04af338b23 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.382914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3263a-c837-4e5a-a99d-ba04af338b23 None admin] RBAC: Adding query filter params (type=network) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:24.383216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3263a-c837-4e5a-a99d-ba04af338b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.384611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3263a-c837-4e5a-a99d-ba04af338b23 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.390728 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 361/719] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:24 2022] GET /identity/v3/services?type=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:25.171615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3159034-4222-421b-8b7e-6652e7198f64 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.172113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3159034-4222-421b-8b7e-6652e7198f64 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.172113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3159034-4222-421b-8b7e-6652e7198f64 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.173713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 359/720] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:25.179676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36880e0d-3ffa-4fed-aca3-0c0152ad5049 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.180087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36880e0d-3ffa-4fed-aca3-0c0152ad5049 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.180298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36880e0d-3ffa-4fed-aca3-0c0152ad5049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.205278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-36880e0d-3ffa-4fed-aca3-0c0152ad5049 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:25.206562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-36880e0d-3ffa-4fed-aca3-0c0152ad5049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:25.245719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:25.279175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 362/721] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:25.311968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3159034-4222-421b-8b7e-6652e7198f64 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:25.425266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3159034-4222-421b-8b7e-6652e7198f64 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:25.459386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585dd0b-dfc6-4a79-aac8-7129249d6b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:25.460001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585dd0b-dfc6-4a79-aac8-7129249d6b99 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.460311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585dd0b-dfc6-4a79-aac8-7129249d6b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.460583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585dd0b-dfc6-4a79-aac8-7129249d6b99 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.461279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585dd0b-dfc6-4a79-aac8-7129249d6b99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:25.462633 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585dd0b-dfc6-4a79-aac8-7129249d6b99 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:25.483544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 360/722] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:27:25 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:25.744343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b665c-0e40-4ca4-86df-830b10ec7607 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.744529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b665c-0e40-4ca4-86df-830b10ec7607 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.744808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b665c-0e40-4ca4-86df-830b10ec7607 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.746466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 363/723] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:25.751991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f712ad-3f2e-4c66-af3b-3ff555b0f536 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.752346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f712ad-3f2e-4c66-af3b-3ff555b0f536 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.752582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f712ad-3f2e-4c66-af3b-3ff555b0f536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.772818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-59f712ad-3f2e-4c66-af3b-3ff555b0f536 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:25.774043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-59f712ad-3f2e-4c66-af3b-3ff555b0f536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:25.850027 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:25.887098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 361/724] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:25 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:25.911591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b665c-0e40-4ca4-86df-830b10ec7607 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.022531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b665c-0e40-4ca4-86df-830b10ec7607 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.057829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7367bc-7f13-4521-b125-e3119c634309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.058469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7367bc-7f13-4521-b125-e3119c634309 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.058750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7367bc-7f13-4521-b125-e3119c634309 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.059019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7367bc-7f13-4521-b125-e3119c634309 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.070005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7367bc-7f13-4521-b125-e3119c634309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ff7367bc-7f13-4521-b125-e3119c634309 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:26.074976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:26.075898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:26.076747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:26.080259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 364/725] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:26.082417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f712ad-3f2e-4c66-af3b-3ff555b0f536 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.198998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f712ad-3f2e-4c66-af3b-3ff555b0f536 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.235675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763e3c3-9f4e-4da6-b69c-c71b8c530391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.236680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763e3c3-9f4e-4da6-b69c-c71b8c530391 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.237154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763e3c3-9f4e-4da6-b69c-c71b8c530391 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.238185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763e3c3-9f4e-4da6-b69c-c71b8c530391 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.239092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763e3c3-9f4e-4da6-b69c-c71b8c530391 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:26.239585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763e3c3-9f4e-4da6-b69c-c71b8c530391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:26.241155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763e3c3-9f4e-4da6-b69c-c71b8c530391 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:26.250264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 362/726] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:26.260172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7367bc-7f13-4521-b125-e3119c634309 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.315465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.358326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a47a35-371c-4cf9-a7f5-a9b3a71b6d33 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.358957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a47a35-371c-4cf9-a7f5-a9b3a71b6d33 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.359423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a47a35-371c-4cf9-a7f5-a9b3a71b6d33 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.361387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 363/727] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:26.375116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041783-f9ca-4b0f-b140-6784ec68c792 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.375705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041783-f9ca-4b0f-b140-6784ec68c792 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.376223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041783-f9ca-4b0f-b140-6784ec68c792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.406763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7b041783-f9ca-4b0f-b140-6784ec68c792 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:26.409126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b041783-f9ca-4b0f-b140-6784ec68c792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:26.419237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7367bc-7f13-4521-b125-e3119c634309 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.454448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.482441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905d1ce-09e5-439f-8df4-bed0da30a1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.483122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905d1ce-09e5-439f-8df4-bed0da30a1dd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.483412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905d1ce-09e5-439f-8df4-bed0da30a1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.483690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3905d1ce-09e5-439f-8df4-bed0da30a1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.485880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 364/728] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:26.496014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905d1ce-09e5-439f-8df4-bed0da30a1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:26.497758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3905d1ce-09e5-439f-8df4-bed0da30a1dd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3905d1ce-09e5-439f-8df4-bed0da30a1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:26.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:26.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:26.521226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:26.521226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:26.521226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:26.521226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:26.523425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 365/729] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:26.529046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b041783-f9ca-4b0f-b140-6784ec68c792 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.550822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905d1ce-09e5-439f-8df4-bed0da30a1dd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.682463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.702534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3905d1ce-09e5-439f-8df4-bed0da30a1dd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.731355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b041783-f9ca-4b0f-b140-6784ec68c792 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.760870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4fdba-b8d4-46a7-b0ab-b6ca4de29807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.761902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4fdba-b8d4-46a7-b0ab-b6ca4de29807 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.762377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4fdba-b8d4-46a7-b0ab-b6ca4de29807 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.762863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4fdba-b8d4-46a7-b0ab-b6ca4de29807 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.780157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874cb7-b16c-486e-9f7a-d69df96fa2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.780157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874cb7-b16c-486e-9f7a-d69df96fa2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.780157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874cb7-b16c-486e-9f7a-d69df96fa2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.780157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874cb7-b16c-486e-9f7a-d69df96fa2f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.780559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874cb7-b16c-486e-9f7a-d69df96fa2f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:26.780559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874cb7-b16c-486e-9f7a-d69df96fa2f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:26.780559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56874cb7-b16c-486e-9f7a-d69df96fa2f3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:26.786712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4fdba-b8d4-46a7-b0ab-b6ca4de29807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:26.796220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 365/730] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3ab4fdba-b8d4-46a7-b0ab-b6ca4de29807 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:26.796398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:26.797231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:26.798046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 366/731] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:26.809363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4fdba-b8d4-46a7-b0ab-b6ca4de29807 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.809521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874cb7-b16c-486e-9f7a-d69df96fa2f3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.849738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.974685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4fdba-b8d4-46a7-b0ab-b6ca4de29807 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.011084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c853fc0-5f98-4924-8c94-db355a60de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.011717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c853fc0-5f98-4924-8c94-db355a60de1d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.011997 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c853fc0-5f98-4924-8c94-db355a60de1d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.012302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c853fc0-5f98-4924-8c94-db355a60de1d None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.013046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c853fc0-5f98-4924-8c94-db355a60de1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:27.013350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c853fc0-5f98-4924-8c94-db355a60de1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.014813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c853fc0-5f98-4924-8c94-db355a60de1d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.032166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 367/732] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:27.032166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9318-468c-494a-bb59-bf456a567269 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.032166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9318-468c-494a-bb59-bf456a567269 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.032166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9318-468c-494a-bb59-bf456a567269 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.032166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 368/733] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:27.032166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb8a7-1ac9-4a5f-9b84-27b53b729aa6 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.032166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb8a7-1ac9-4a5f-9b84-27b53b729aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.032713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abb8a7-1ac9-4a5f-9b84-27b53b729aa6 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.034105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 369/734] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:27.035776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abb8a7-1ac9-4a5f-9b84-27b53b729aa6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.039888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.065781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874cb7-b16c-486e-9f7a-d69df96fa2f3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.102558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502373e-7e1d-44af-b6f8-413179ff9354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.103250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502373e-7e1d-44af-b6f8-413179ff9354 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.103474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502373e-7e1d-44af-b6f8-413179ff9354 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.103749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502373e-7e1d-44af-b6f8-413179ff9354 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.111006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502373e-7e1d-44af-b6f8-413179ff9354 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.112444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502373e-7e1d-44af-b6f8-413179ff9354 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-e502373e-7e1d-44af-b6f8-413179ff9354 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:27.124032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:27.125103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:27.126025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 366/735] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:27.126588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be03eb2-ca67-42c5-804d-435decb44953 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.126588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be03eb2-ca67-42c5-804d-435decb44953 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.127265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be03eb2-ca67-42c5-804d-435decb44953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.147922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1be03eb2-ca67-42c5-804d-435decb44953 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:27.149019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abb8a7-1ac9-4a5f-9b84-27b53b729aa6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.149147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1be03eb2-ca67-42c5-804d-435decb44953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:27.185480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64091361-1884-4e66-99d7-875ba0e8851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.186264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64091361-1884-4e66-99d7-875ba0e8851f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.186546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64091361-1884-4e66-99d7-875ba0e8851f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.186817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64091361-1884-4e66-99d7-875ba0e8851f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.198239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64091361-1884-4e66-99d7-875ba0e8851f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.199736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64091361-1884-4e66-99d7-875ba0e8851f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-64091361-1884-4e66-99d7-875ba0e8851f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:27.214774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:27.215857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:27.216921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:27.216921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:27.216921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:27.216921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:27.216921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 370/736] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:27.217567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b852-44be-432d-8fa3-8b13f2e60f3c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.217849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b852-44be-432d-8fa3-8b13f2e60f3c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.218117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1b852-44be-432d-8fa3-8b13f2e60f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.230700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 367/737] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:27.232188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be03eb2-ca67-42c5-804d-435decb44953 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.245933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-59a1b852-44be-432d-8fa3-8b13f2e60f3c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:27.247459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-59a1b852-44be-432d-8fa3-8b13f2e60f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:27.265327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.306447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.324173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 371/738] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:27.325283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b852-44be-432d-8fa3-8b13f2e60f3c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.356461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be03eb2-ca67-42c5-804d-435decb44953 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.390467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270fd62-0c16-404c-98e5-fe546199fdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.391077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270fd62-0c16-404c-98e5-fe546199fdcc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.391354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270fd62-0c16-404c-98e5-fe546199fdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.391628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270fd62-0c16-404c-98e5-fe546199fdcc None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.392440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270fd62-0c16-404c-98e5-fe546199fdcc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:27.392743 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270fd62-0c16-404c-98e5-fe546199fdcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.394712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270fd62-0c16-404c-98e5-fe546199fdcc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.416119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 368/739] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:27.416119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270fd62-0c16-404c-98e5-fe546199fdcc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.441488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1b852-44be-432d-8fa3-8b13f2e60f3c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.477970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa7806-b375-4856-b13d-15b74db3e5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.478584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa7806-b375-4856-b13d-15b74db3e5fd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.478851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa7806-b375-4856-b13d-15b74db3e5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.479125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa7806-b375-4856-b13d-15b74db3e5fd None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.479816 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa7806-b375-4856-b13d-15b74db3e5fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:27.480148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa7806-b375-4856-b13d-15b74db3e5fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.481561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa7806-b375-4856-b13d-15b74db3e5fd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.493463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 372/740] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:27.496330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.496967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa7806-b375-4856-b13d-15b74db3e5fd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.521115 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270fd62-0c16-404c-98e5-fe546199fdcc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.546093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.556914 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f012bf8-9524-4f54-b18e-58f01ba72d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.557552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012bf8-9524-4f54-b18e-58f01ba72d36 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.557826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012bf8-9524-4f54-b18e-58f01ba72d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.558093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f012bf8-9524-4f54-b18e-58f01ba72d36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.568748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f012bf8-9524-4f54-b18e-58f01ba72d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9f012bf8-9524-4f54-b18e-58f01ba72d36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:27.573579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:27.574485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:27.575851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 369/741] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:27.576586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f012bf8-9524-4f54-b18e-58f01ba72d36 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.608398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa7806-b375-4856-b13d-15b74db3e5fd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.645555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037fb55-196a-4dc8-8bf9-36f8932e47a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.646172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037fb55-196a-4dc8-8bf9-36f8932e47a9 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.646449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037fb55-196a-4dc8-8bf9-36f8932e47a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.646716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037fb55-196a-4dc8-8bf9-36f8932e47a9 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.647400 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037fb55-196a-4dc8-8bf9-36f8932e47a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.648793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037fb55-196a-4dc8-8bf9-36f8932e47a9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.676185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 373/742] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:27:27 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:27.676185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037fb55-196a-4dc8-8bf9-36f8932e47a9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.687332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f012bf8-9524-4f54-b18e-58f01ba72d36 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.747944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648866be-088e-471e-bc60-8cf66605123a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.749157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648866be-088e-471e-bc60-8cf66605123a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.749440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648866be-088e-471e-bc60-8cf66605123a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.749712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648866be-088e-471e-bc60-8cf66605123a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.762479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.814122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037fb55-196a-4dc8-8bf9-36f8932e47a9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.824919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.849108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648866be-088e-471e-bc60-8cf66605123a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.850563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648866be-088e-471e-bc60-8cf66605123a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.867726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01751a4-6434-4503-8df2-caeeb9d80fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.868406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01751a4-6434-4503-8df2-caeeb9d80fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.868683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01751a4-6434-4503-8df2-caeeb9d80fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.868949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01751a4-6434-4503-8df2-caeeb9d80fb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.881634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01751a4-6434-4503-8df2-caeeb9d80fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.882218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01751a4-6434-4503-8df2-caeeb9d80fb4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f01751a4-6434-4503-8df2-caeeb9d80fb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:27.900485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:27.901443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:27.902972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 374/743] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:27.903568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01751a4-6434-4503-8df2-caeeb9d80fb4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.969647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 370/744] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:27:27.969647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648866be-088e-471e-bc60-8cf66605123a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.009101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.034253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01751a4-6434-4503-8df2-caeeb9d80fb4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.071837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c1d7-13a5-400f-82f4-ca81f46decfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.072777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c1d7-13a5-400f-82f4-ca81f46decfa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.073204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c1d7-13a5-400f-82f4-ca81f46decfa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.073625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52c1d7-13a5-400f-82f4-ca81f46decfa None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.073738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648866be-088e-471e-bc60-8cf66605123a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.074589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c1d7-13a5-400f-82f4-ca81f46decfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:28.075051 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c1d7-13a5-400f-82f4-ca81f46decfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.077865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52c1d7-13a5-400f-82f4-ca81f46decfa None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.087549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 375/745] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:28.088328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c1d7-13a5-400f-82f4-ca81f46decfa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.113491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c5d49-b94a-4ee1-8b77-97b07c3952a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.114106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c5d49-b94a-4ee1-8b77-97b07c3952a9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.114386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c5d49-b94a-4ee1-8b77-97b07c3952a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.114659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c5d49-b94a-4ee1-8b77-97b07c3952a9 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.115444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c5d49-b94a-4ee1-8b77-97b07c3952a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:28.115745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c5d49-b94a-4ee1-8b77-97b07c3952a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.117240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c5d49-b94a-4ee1-8b77-97b07c3952a9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.118833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.141285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 371/746] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:28.141285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd8727-7432-47f3-ac74-410b1ec81bb0 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.141285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd8727-7432-47f3-ac74-410b1ec81bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.141285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd8727-7432-47f3-ac74-410b1ec81bb0 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.141285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 372/747] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:28.141285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd8727-7432-47f3-ac74-410b1ec81bb0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.211606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52c1d7-13a5-400f-82f4-ca81f46decfa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.248513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378784f1-c823-4513-83bb-f83757c67aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.249153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378784f1-c823-4513-83bb-f83757c67aae None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.249436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378784f1-c823-4513-83bb-f83757c67aae None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.249710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378784f1-c823-4513-83bb-f83757c67aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.261263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.263027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378784f1-c823-4513-83bb-f83757c67aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.264530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378784f1-c823-4513-83bb-f83757c67aae None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.270184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd8727-7432-47f3-ac74-410b1ec81bb0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-378784f1-c823-4513-83bb-f83757c67aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:28.280082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:28.281166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:28.286809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:28.286809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:28.286809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:28.286809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:28.286809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 376/748] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:28.286809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378784f1-c823-4513-83bb-f83757c67aae None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.312983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57a64d-615f-4337-a344-2404dad33aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.313753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57a64d-615f-4337-a344-2404dad33aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.314062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57a64d-615f-4337-a344-2404dad33aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.314401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57a64d-615f-4337-a344-2404dad33aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.325034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57a64d-615f-4337-a344-2404dad33aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.326576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57a64d-615f-4337-a344-2404dad33aa2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ec57a64d-615f-4337-a344-2404dad33aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:28.340931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:28.341983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:28.343054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:28.343054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:28.343054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:28.343054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:28.343936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 373/749] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:28.345091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad667806-e901-468e-9255-f6710940f68d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.345378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad667806-e901-468e-9255-f6710940f68d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.345651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad667806-e901-468e-9255-f6710940f68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.363543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ad667806-e901-468e-9255-f6710940f68d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:28.364757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ad667806-e901-468e-9255-f6710940f68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:28.376925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.399686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378784f1-c823-4513-83bb-f83757c67aae None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.434809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939bd31-ef0e-44e4-affa-47e08eab4cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.435430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939bd31-ef0e-44e4-affa-47e08eab4cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.435712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939bd31-ef0e-44e4-affa-47e08eab4cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.435988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939bd31-ef0e-44e4-affa-47e08eab4cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.443728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 374/750] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:28.448567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad667806-e901-468e-9255-f6710940f68d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.514028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939bd31-ef0e-44e4-affa-47e08eab4cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.515495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939bd31-ef0e-44e4-affa-47e08eab4cc8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.533787 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.559119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad667806-e901-468e-9255-f6710940f68d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.594016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de272086-2237-4889-a7a6-9dc683b71fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.594638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de272086-2237-4889-a7a6-9dc683b71fad None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.594920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de272086-2237-4889-a7a6-9dc683b71fad None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.595790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de272086-2237-4889-a7a6-9dc683b71fad None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.595901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de272086-2237-4889-a7a6-9dc683b71fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:28.596200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de272086-2237-4889-a7a6-9dc683b71fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.598268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de272086-2237-4889-a7a6-9dc683b71fad None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.606696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.611249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 375/751] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:28.616818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de272086-2237-4889-a7a6-9dc683b71fad None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.633801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 377/752] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:27:28.633801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939bd31-ef0e-44e4-affa-47e08eab4cc8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.727176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de272086-2237-4889-a7a6-9dc683b71fad None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.732956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939bd31-ef0e-44e4-affa-47e08eab4cc8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.762957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fee57c-9276-431f-b7fe-3b9f14bbf63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.763584 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fee57c-9276-431f-b7fe-3b9f14bbf63c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.763862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fee57c-9276-431f-b7fe-3b9f14bbf63c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.764208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fee57c-9276-431f-b7fe-3b9f14bbf63c None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.764845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fee57c-9276-431f-b7fe-3b9f14bbf63c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:28.765148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fee57c-9276-431f-b7fe-3b9f14bbf63c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.766501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fee57c-9276-431f-b7fe-3b9f14bbf63c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.772069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c828f36-9017-4c42-94a5-a4a32468a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.772891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c828f36-9017-4c42-94a5-a4a32468a521 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.773285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.774185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c828f36-9017-4c42-94a5-a4a32468a521 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.774487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c828f36-9017-4c42-94a5-a4a32468a521 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.775279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c828f36-9017-4c42-94a5-a4a32468a521 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.776835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c828f36-9017-4c42-94a5-a4a32468a521 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.782928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 376/753] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:28.782928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fee57c-9276-431f-b7fe-3b9f14bbf63c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5c828f36-9017-4c42-94a5-a4a32468a521 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:28.792652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:28.793583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:28.794404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 378/754] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:28.795857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c828f36-9017-4c42-94a5-a4a32468a521 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.845806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.899217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fee57c-9276-431f-b7fe-3b9f14bbf63c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.906115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c828f36-9017-4c42-94a5-a4a32468a521 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.935431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91034a-bd16-43ed-9881-7406392b7b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.936073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91034a-bd16-43ed-9881-7406392b7b74 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.936390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91034a-bd16-43ed-9881-7406392b7b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.936662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91034a-bd16-43ed-9881-7406392b7b74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.943231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2cc71-0657-4e3a-807b-9682d06af813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.943389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91034a-bd16-43ed-9881-7406392b7b74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.944224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2cc71-0657-4e3a-807b-9682d06af813 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.944698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2cc71-0657-4e3a-807b-9682d06af813 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.944804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91034a-bd16-43ed-9881-7406392b7b74 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.945236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2cc71-0657-4e3a-807b-9682d06af813 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8d91034a-bd16-43ed-9881-7406392b7b74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:28.955678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:28.956672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:28.957764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:28.957764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:28.957764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:28.957764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:28.957764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:28.957764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:28.957764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:28.957764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:28.958873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2cc71-0657-4e3a-807b-9682d06af813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.960496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2cc71-0657-4e3a-807b-9682d06af813 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.961469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 377/755] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:28.962291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91034a-bd16-43ed-9881-7406392b7b74 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-bdf2cc71-0657-4e3a-807b-9682d06af813 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:28.976894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:28.977857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:28.978911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:28.978911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:28.978911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:28.978911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:28.980773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 379/756] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:28.981682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2cc71-0657-4e3a-807b-9682d06af813 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.025812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.071956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91034a-bd16-43ed-9881-7406392b7b74 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.083385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.090955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2cc71-0657-4e3a-807b-9682d06af813 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.106107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab75023-814a-435b-8b36-211fe79a3d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.106805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75023-814a-435b-8b36-211fe79a3d35 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.107020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75023-814a-435b-8b36-211fe79a3d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.107296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75023-814a-435b-8b36-211fe79a3d35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.115132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab75023-814a-435b-8b36-211fe79a3d35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.116604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab75023-814a-435b-8b36-211fe79a3d35 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.127032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2a8c3-3834-4516-9fd7-eedfc27451cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.127638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2a8c3-3834-4516-9fd7-eedfc27451cd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.127915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2a8c3-3834-4516-9fd7-eedfc27451cd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1ab75023-814a-435b-8b36-211fe79a3d35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:29.128039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:29.128943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:29.129871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:29.130400 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2a8c3-3834-4516-9fd7-eedfc27451cd None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.130400 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2a8c3-3834-4516-9fd7-eedfc27451cd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.130536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 378/757] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:29.130536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab75023-814a-435b-8b36-211fe79a3d35 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.133810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2a8c3-3834-4516-9fd7-eedfc27451cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.135201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2a8c3-3834-4516-9fd7-eedfc27451cd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.145143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 380/758] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.145143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2a8c3-3834-4516-9fd7-eedfc27451cd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.241871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab75023-814a-435b-8b36-211fe79a3d35 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.251854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2a8c3-3834-4516-9fd7-eedfc27451cd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.259786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.278005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ab28-3772-48bf-a90f-7a7c78ceea04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.278613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ab28-3772-48bf-a90f-7a7c78ceea04 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.278827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ab28-3772-48bf-a90f-7a7c78ceea04 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.279100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3ab28-3772-48bf-a90f-7a7c78ceea04 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.280109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ab28-3772-48bf-a90f-7a7c78ceea04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.280446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ab28-3772-48bf-a90f-7a7c78ceea04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.282128 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3ab28-3772-48bf-a90f-7a7c78ceea04 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.289632 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43aa8d-52f5-46b4-95f2-f46a7ac4e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.290331 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43aa8d-52f5-46b4-95f2-f46a7ac4e51b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.290619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43aa8d-52f5-46b4-95f2-f46a7ac4e51b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.290898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb43aa8d-52f5-46b4-95f2-f46a7ac4e51b None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.291599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43aa8d-52f5-46b4-95f2-f46a7ac4e51b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.291904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43aa8d-52f5-46b4-95f2-f46a7ac4e51b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.293306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb43aa8d-52f5-46b4-95f2-f46a7ac4e51b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.296689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 379/759] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.297796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ab28-3772-48bf-a90f-7a7c78ceea04 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.306587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 381/760] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.307411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43aa8d-52f5-46b4-95f2-f46a7ac4e51b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.332743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.411410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3ab28-3772-48bf-a90f-7a7c78ceea04 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.416680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb43aa8d-52f5-46b4-95f2-f46a7ac4e51b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.451799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e0347-2ea1-43b6-b92c-d652859310ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.452449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e0347-2ea1-43b6-b92c-d652859310ee None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.452753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e0347-2ea1-43b6-b92c-d652859310ee None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.453021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e0347-2ea1-43b6-b92c-d652859310ee None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.453648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945536-d89f-4948-8679-d5e0482731e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.453810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e0347-2ea1-43b6-b92c-d652859310ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.454116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e0347-2ea1-43b6-b92c-d652859310ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.454531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945536-d89f-4948-8679-d5e0482731e4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.454910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945536-d89f-4948-8679-d5e0482731e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.455277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc945536-d89f-4948-8679-d5e0482731e4 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.455533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e0347-2ea1-43b6-b92c-d652859310ee None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.456710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc945536-d89f-4948-8679-d5e0482731e4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.457181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc945536-d89f-4948-8679-d5e0482731e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.458635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc945536-d89f-4948-8679-d5e0482731e4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.463641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 382/761] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.464540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945536-d89f-4948-8679-d5e0482731e4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.479091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 380/762] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.480169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e0347-2ea1-43b6-b92c-d652859310ee None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.516960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.576174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.584860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e0347-2ea1-43b6-b92c-d652859310ee None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.598791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc945536-d89f-4948-8679-d5e0482731e4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.620333 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f1edf-3522-40fc-9e07-ed1bd58ac6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.620982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f1edf-3522-40fc-9e07-ed1bd58ac6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.621532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f1edf-3522-40fc-9e07-ed1bd58ac6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.621641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f1edf-3522-40fc-9e07-ed1bd58ac6d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.629293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f1edf-3522-40fc-9e07-ed1bd58ac6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.630683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f1edf-3522-40fc-9e07-ed1bd58ac6d3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.635812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeb6f5-1516-4eac-a435-2d1a74b67cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.636457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb6f5-1516-4eac-a435-2d1a74b67cef None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.636746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb6f5-1516-4eac-a435-2d1a74b67cef None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.637029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aeb6f5-1516-4eac-a435-2d1a74b67cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.637804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeb6f5-1516-4eac-a435-2d1a74b67cef None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.638115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeb6f5-1516-4eac-a435-2d1a74b67cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.639540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aeb6f5-1516-4eac-a435-2d1a74b67cef None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-456f1edf-3522-40fc-9e07-ed1bd58ac6d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:29.642538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:29.643575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 381/763] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:29.645326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f1edf-3522-40fc-9e07-ed1bd58ac6d3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.649700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 383/764] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/role_assignments?user.id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.650683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeb6f5-1516-4eac-a435-2d1a74b67cef None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.761685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.768179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f1edf-3522-40fc-9e07-ed1bd58ac6d3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.783357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aeb6f5-1516-4eac-a435-2d1a74b67cef None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.812476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9fb1-047c-4669-b6b5-9ba333ec92ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.813109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9fb1-047c-4669-b6b5-9ba333ec92ea None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.813392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9fb1-047c-4669-b6b5-9ba333ec92ea None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.813660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f9fb1-047c-4669-b6b5-9ba333ec92ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.814422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f9fb1-047c-4669-b6b5-9ba333ec92ea None admin] RBAC: Adding query filter params (interface=public, service_id=733d4172c5a44e2eac88d688e7328d0f, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.814733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f9fb1-047c-4669-b6b5-9ba333ec92ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.817314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f9fb1-047c-4669-b6b5-9ba333ec92ea None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.823240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b4213-8015-4212-982f-73c84a988eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.823882 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4213-8015-4212-982f-73c84a988eca None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.824185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4213-8015-4212-982f-73c84a988eca None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.824470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b4213-8015-4212-982f-73c84a988eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.829139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 382/765] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/endpoints?service_id=733d4172c5a44e2eac88d688e7328d0f&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.829139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9fb1-047c-4669-b6b5-9ba333ec92ea None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.840029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b4213-8015-4212-982f-73c84a988eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.841583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b4213-8015-4212-982f-73c84a988eca None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.849681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-150b4213-8015-4212-982f-73c84a988eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:29.856595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:29.857655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:29.858747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:29.858747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:29.858747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:29.858747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:29.863165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 384/766] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:29.864517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79d42-ca38-4877-a336-ab488e739d1e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.864810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79d42-ca38-4877-a336-ab488e739d1e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.865089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf79d42-ca38-4877-a336-ab488e739d1e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.866546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 385/767] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:29.867063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf79d42-ca38-4877-a336-ab488e739d1e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.944191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f9fb1-047c-4669-b6b5-9ba333ec92ea None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.982512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37efe5-0686-4001-bda7-e0acecf537d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.983383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37efe5-0686-4001-bda7-e0acecf537d8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.983729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37efe5-0686-4001-bda7-e0acecf537d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.984071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37efe5-0686-4001-bda7-e0acecf537d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.984243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf79d42-ca38-4877-a336-ab488e739d1e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.984975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37efe5-0686-4001-bda7-e0acecf537d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.985351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37efe5-0686-4001-bda7-e0acecf537d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.987073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37efe5-0686-4001-bda7-e0acecf537d8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.006951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 383/768] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.006951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37efe5-0686-4001-bda7-e0acecf537d8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.024969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06ef78-5192-471e-a81a-fe264a5751b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.025582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ef78-5192-471e-a81a-fe264a5751b6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.025866 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ef78-5192-471e-a81a-fe264a5751b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.026177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ef78-5192-471e-a81a-fe264a5751b6 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.026836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06ef78-5192-471e-a81a-fe264a5751b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.027624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.028265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f06ef78-5192-471e-a81a-fe264a5751b6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.044166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 386/769] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.044166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0f4d9-e78a-4e3d-bd3e-f51a1869b2db None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.044166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0f4d9-e78a-4e3d-bd3e-f51a1869b2db None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.044166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0f4d9-e78a-4e3d-bd3e-f51a1869b2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.061936 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-78c0f4d9-e78a-4e3d-bd3e-f51a1869b2db None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:30.063300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-78c0f4d9-e78a-4e3d-bd3e-f51a1869b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:30.139966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37efe5-0686-4001-bda7-e0acecf537d8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.140450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.153669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 387/770] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:30.154898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0f4d9-e78a-4e3d-bd3e-f51a1869b2db None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.191576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45090cb-5b84-4ac2-aff2-02d49a29dc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.192378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45090cb-5b84-4ac2-aff2-02d49a29dc9a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.192727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45090cb-5b84-4ac2-aff2-02d49a29dc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.193113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45090cb-5b84-4ac2-aff2-02d49a29dc9a None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.194036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45090cb-5b84-4ac2-aff2-02d49a29dc9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:30.194410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45090cb-5b84-4ac2-aff2-02d49a29dc9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.196042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45090cb-5b84-4ac2-aff2-02d49a29dc9a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.210385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 384/771] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.211324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45090cb-5b84-4ac2-aff2-02d49a29dc9a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.274818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0f4d9-e78a-4e3d-bd3e-f51a1869b2db None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.309661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.317810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1555351-bf41-42fd-9fb0-43fa95990e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.318748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1555351-bf41-42fd-9fb0-43fa95990e5c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.319167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1555351-bf41-42fd-9fb0-43fa95990e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.319580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1555351-bf41-42fd-9fb0-43fa95990e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.320540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1555351-bf41-42fd-9fb0-43fa95990e5c None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=31a94e98e1b2499f8417dd10d00e780e) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:30.321005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1555351-bf41-42fd-9fb0-43fa95990e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.322849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1555351-bf41-42fd-9fb0-43fa95990e5c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.329327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 388/772] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/role_assignments?user.id=31a94e98e1b2499f8417dd10d00e780e&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.330310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1555351-bf41-42fd-9fb0-43fa95990e5c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.332312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45090cb-5b84-4ac2-aff2-02d49a29dc9a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.377333 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b35f9-570b-476a-893e-cf8388b395fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.378332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b35f9-570b-476a-893e-cf8388b395fe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.378762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b35f9-570b-476a-893e-cf8388b395fe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.379175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b35f9-570b-476a-893e-cf8388b395fe None admin] PATH_INFO: `/v3/services/network` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.380124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b35f9-570b-476a-893e-cf8388b395fe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.381815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b35f9-570b-476a-893e-cf8388b395fe None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-692b35f9-570b-476a-893e-cf8388b395fe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:30.392366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:30.393577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:27:30.394515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:30.397039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 385/773] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:30.403949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b35f9-570b-476a-893e-cf8388b395fe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.406147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.504245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1555351-bf41-42fd-9fb0-43fa95990e5c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.555730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a121d-a250-4f7c-93ea-705f167ea656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.556025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b35f9-570b-476a-893e-cf8388b395fe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.556414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a121d-a250-4f7c-93ea-705f167ea656 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.556696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a121d-a250-4f7c-93ea-705f167ea656 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.556969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a121d-a250-4f7c-93ea-705f167ea656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.574754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a121d-a250-4f7c-93ea-705f167ea656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.576221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a121d-a250-4f7c-93ea-705f167ea656 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-641a121d-a250-4f7c-93ea-705f167ea656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:30.593332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:30.594460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:30.595416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:30.595416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:30.595416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:30.595416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:30.595416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:30.595416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:30.595416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:30.595416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:30.595416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 389/774] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:30.604759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad06b1-e09f-476e-a46a-13e0e03d4e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.604759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad06b1-e09f-476e-a46a-13e0e03d4e9f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.604759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad06b1-e09f-476e-a46a-13e0e03d4e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.604759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad06b1-e09f-476e-a46a-13e0e03d4e9f None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.605097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad06b1-e09f-476e-a46a-13e0e03d4e9f None admin] RBAC: Adding query filter params (name=network) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:30.605097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad06b1-e09f-476e-a46a-13e0e03d4e9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.605097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad06b1-e09f-476e-a46a-13e0e03d4e9f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.605311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a121d-a250-4f7c-93ea-705f167ea656 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.609207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 386/775] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:30.614762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad06b1-e09f-476e-a46a-13e0e03d4e9f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.626919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.778385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a121d-a250-4f7c-93ea-705f167ea656 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.807502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad06b1-e09f-476e-a46a-13e0e03d4e9f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.808465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.832079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36da5-54fa-4dd5-9dcb-eda8b8520b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.832730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36da5-54fa-4dd5-9dcb-eda8b8520b21 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.833019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36da5-54fa-4dd5-9dcb-eda8b8520b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.833299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36da5-54fa-4dd5-9dcb-eda8b8520b21 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.834060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36da5-54fa-4dd5-9dcb-eda8b8520b21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:30.834369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36da5-54fa-4dd5-9dcb-eda8b8520b21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.835843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36da5-54fa-4dd5-9dcb-eda8b8520b21 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.863629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 390/776] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.871268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36da5-54fa-4dd5-9dcb-eda8b8520b21 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.882168 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce1646-5070-4989-947d-9902ac16b728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.882795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce1646-5070-4989-947d-9902ac16b728 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.883070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce1646-5070-4989-947d-9902ac16b728 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.883347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce1646-5070-4989-947d-9902ac16b728 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.884420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce1646-5070-4989-947d-9902ac16b728 None admin] RBAC: Adding query filter params (type=network) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:30.884725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce1646-5070-4989-947d-9902ac16b728 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.886419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce1646-5070-4989-947d-9902ac16b728 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.900455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 387/777] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.905540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce1646-5070-4989-947d-9902ac16b728 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:31.012565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:31.049841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36da5-54fa-4dd5-9dcb-eda8b8520b21 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.091979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce1646-5070-4989-947d-9902ac16b728 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.093380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a8224-62ad-427d-9221-cc95378f00b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.100163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a8224-62ad-427d-9221-cc95378f00b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.100163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a8224-62ad-427d-9221-cc95378f00b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.100163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a8224-62ad-427d-9221-cc95378f00b2 None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/cab044fcd0dd449eafaccb81606d15ce/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.100163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a8224-62ad-427d-9221-cc95378f00b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=cab044fcd0dd449eafaccb81606d15ce, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.100163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a8224-62ad-427d-9221-cc95378f00b2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.121869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 391/778] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:30 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/cab044fcd0dd449eafaccb81606d15ce/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:31.136853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff61719-2b80-479d-9b10-1f294ac710fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.137951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61719-2b80-479d-9b10-1f294ac710fb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.138460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61719-2b80-479d-9b10-1f294ac710fb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.138982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff61719-2b80-479d-9b10-1f294ac710fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.139952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff61719-2b80-479d-9b10-1f294ac710fb None admin] RBAC: Adding query filter params (interface=public, service_id=708df922373b48af8d2d1249cf0cefca, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:31.140483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff61719-2b80-479d-9b10-1f294ac710fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.142154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff61719-2b80-479d-9b10-1f294ac710fb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.149401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 388/779] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/endpoints?service_id=708df922373b48af8d2d1249cf0cefca&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:31.160191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a8224-62ad-427d-9221-cc95378f00b2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:31.222036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:31.304899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a8224-62ad-427d-9221-cc95378f00b2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.346024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9480a-aba3-47f4-976d-526b5543d21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.346646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9480a-aba3-47f4-976d-526b5543d21a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.346929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9480a-aba3-47f4-976d-526b5543d21a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.347265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9480a-aba3-47f4-976d-526b5543d21a None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.347933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9480a-aba3-47f4-976d-526b5543d21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.349332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9480a-aba3-47f4-976d-526b5543d21a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.355103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 392/780] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 21:27:31 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:31.919306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd5efa-5353-4f72-9c17-43c2014711a6 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.920176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd5efa-5353-4f72-9c17-43c2014711a6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.920589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd5efa-5353-4f72-9c17-43c2014711a6 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.922069 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 389/781] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:31.927401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eee0a-1a5a-4eb1-831e-11a9c3e5910f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.928181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eee0a-1a5a-4eb1-831e-11a9c3e5910f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.928598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eee0a-1a5a-4eb1-831e-11a9c3e5910f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.957640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8a9eee0a-1a5a-4eb1-831e-11a9c3e5910f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:31.959071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8a9eee0a-1a5a-4eb1-831e-11a9c3e5910f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:32.045783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 393/782] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:27:32.068254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd5efa-5353-4f72-9c17-43c2014711a6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.241993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd5efa-5353-4f72-9c17-43c2014711a6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:32.295482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141170f2-1a27-4467-bf26-c6df779dab41 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.295803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141170f2-1a27-4467-bf26-c6df779dab41 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.296031 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141170f2-1a27-4467-bf26-c6df779dab41 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.297620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 394/783] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:32.299281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0e98-1bc6-4fb1-9505-e09d81ce1db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:32.300512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0e98-1bc6-4fb1-9505-e09d81ce1db7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.300801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0e98-1bc6-4fb1-9505-e09d81ce1db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.301074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e0e98-1bc6-4fb1-9505-e09d81ce1db7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.303092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ef433-d96c-4f81-8c51-b596fbc8fe2a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.303500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ef433-d96c-4f81-8c51-b596fbc8fe2a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.303872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ef433-d96c-4f81-8c51-b596fbc8fe2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.304516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:32.314046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e0e98-1bc6-4fb1-9505-e09d81ce1db7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-651e0e98-1bc6-4fb1-9505-e09d81ce1db7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:32.319759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:32.320883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:32.321860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:32.325227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 390/784] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:32.332189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0e98-1bc6-4fb1-9505-e09d81ce1db7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.349219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-955ef433-d96c-4f81-8c51-b596fbc8fe2a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:32.350529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-955ef433-d96c-4f81-8c51-b596fbc8fe2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:32.402587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:32.437092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e0e98-1bc6-4fb1-9505-e09d81ce1db7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:32.475627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b500b-2722-4d88-ba94-ed4b59ee18d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:32.476447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b500b-2722-4d88-ba94-ed4b59ee18d2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.476729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b500b-2722-4d88-ba94-ed4b59ee18d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.477004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b500b-2722-4d88-ba94-ed4b59ee18d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.477740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b500b-2722-4d88-ba94-ed4b59ee18d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:32.477951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 395/785] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:32.478053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b500b-2722-4d88-ba94-ed4b59ee18d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:32.482742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b500b-2722-4d88-ba94-ed4b59ee18d2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:32.488918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 391/786] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:32.494486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ef433-d96c-4f81-8c51-b596fbc8fe2a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.511429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b500b-2722-4d88-ba94-ed4b59ee18d2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.584652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:32.621635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b500b-2722-4d88-ba94-ed4b59ee18d2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:32.658648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059196f-9133-43d6-84b2-2b977cd26dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:32.659380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059196f-9133-43d6-84b2-2b977cd26dbf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.659668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059196f-9133-43d6-84b2-2b977cd26dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.659934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059196f-9133-43d6-84b2-2b977cd26dbf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.660642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059196f-9133-43d6-84b2-2b977cd26dbf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:32.662007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059196f-9133-43d6-84b2-2b977cd26dbf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5059196f-9133-43d6-84b2-2b977cd26dbf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:32.672322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:32.673259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:32.674265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 392/787] 10.222.0.57 () {56 vars in 1129 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:32.681039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059196f-9133-43d6-84b2-2b977cd26dbf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.769720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ef433-d96c-4f81-8c51-b596fbc8fe2a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:32.832399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f3311-7629-4b01-b60e-7554f5fab0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:32.833340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3311-7629-4b01-b60e-7554f5fab0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.833737 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3311-7629-4b01-b60e-7554f5fab0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.834210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f3311-7629-4b01-b60e-7554f5fab0f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.845398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3311-7629-4b01-b60e-7554f5fab0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:32.847276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f3311-7629-4b01-b60e-7554f5fab0f6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:32.849133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059196f-9133-43d6-84b2-2b977cd26dbf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-a55f3311-7629-4b01-b60e-7554f5fab0f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:32.864492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:32.865558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:32.866407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:32.866407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:32.866407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:32.866407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:32.866918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 396/788] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:32.868309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a91a-f52e-4c8d-b2eb-deb57b4a13c1 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.868556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a91a-f52e-4c8d-b2eb-deb57b4a13c1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.868832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a91a-f52e-4c8d-b2eb-deb57b4a13c1 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.874280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 397/789] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:32.874597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:32.876162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a91a-f52e-4c8d-b2eb-deb57b4a13c1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.885687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b16ff3-34eb-4f72-94a2-6aa8ad2a0685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:32.886300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b16ff3-34eb-4f72-94a2-6aa8ad2a0685 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.886577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b16ff3-34eb-4f72-94a2-6aa8ad2a0685 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.886849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b16ff3-34eb-4f72-94a2-6aa8ad2a0685 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.887517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b16ff3-34eb-4f72-94a2-6aa8ad2a0685 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:32.887814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b16ff3-34eb-4f72-94a2-6aa8ad2a0685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:32.889231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b16ff3-34eb-4f72-94a2-6aa8ad2a0685 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:32.894533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:32.898599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 393/790] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:32.899980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ec8bd-014d-4fc1-8f5c-4f1d18c6457d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.900286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ec8bd-014d-4fc1-8f5c-4f1d18c6457d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.900563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ec8bd-014d-4fc1-8f5c-4f1d18c6457d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.918071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2b9ec8bd-014d-4fc1-8f5c-4f1d18c6457d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:32.919255 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2b9ec8bd-014d-4fc1-8f5c-4f1d18c6457d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:32.988847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 394/791] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:32.989777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ec8bd-014d-4fc1-8f5c-4f1d18c6457d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.997585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a91a-f52e-4c8d-b2eb-deb57b4a13c1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.044116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec511b77-4e9a-4ad1-9248-8daafd41f51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.045162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec511b77-4e9a-4ad1-9248-8daafd41f51a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.045644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec511b77-4e9a-4ad1-9248-8daafd41f51a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.046434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec511b77-4e9a-4ad1-9248-8daafd41f51a None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.048015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec511b77-4e9a-4ad1-9248-8daafd41f51a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:33.048638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec511b77-4e9a-4ad1-9248-8daafd41f51a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.051127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec511b77-4e9a-4ad1-9248-8daafd41f51a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.069946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 398/792] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:33.071045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec511b77-4e9a-4ad1-9248-8daafd41f51a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.118358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ec8bd-014d-4fc1-8f5c-4f1d18c6457d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.138012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:33.161657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81106d70-58eb-47aa-894e-8abfe4d3d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.162464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81106d70-58eb-47aa-894e-8abfe4d3d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.162949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81106d70-58eb-47aa-894e-8abfe4d3d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.163315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81106d70-58eb-47aa-894e-8abfe4d3d2d0 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.164701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81106d70-58eb-47aa-894e-8abfe4d3d2d0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:33.165016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81106d70-58eb-47aa-894e-8abfe4d3d2d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.166387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81106d70-58eb-47aa-894e-8abfe4d3d2d0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.172368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 395/793] 10.222.0.57 () {56 vars in 1124 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:33.172599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:33.174075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81106d70-58eb-47aa-894e-8abfe4d3d2d0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.203757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec511b77-4e9a-4ad1-9248-8daafd41f51a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.246221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0910459-ac41-497a-ae4c-99055cfb9606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.247134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0910459-ac41-497a-ae4c-99055cfb9606 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.247420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0910459-ac41-497a-ae4c-99055cfb9606 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.247694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0910459-ac41-497a-ae4c-99055cfb9606 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.260506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0910459-ac41-497a-ae4c-99055cfb9606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e0910459-ac41-497a-ae4c-99055cfb9606 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:33.266394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:33.267309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:33.268157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 399/794] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:33.268881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0910459-ac41-497a-ae4c-99055cfb9606 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.302855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81106d70-58eb-47aa-894e-8abfe4d3d2d0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.344733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370654d-881c-49cb-aab4-b4993283b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.346217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370654d-881c-49cb-aab4-b4993283b0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.347372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370654d-881c-49cb-aab4-b4993283b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.347962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370654d-881c-49cb-aab4-b4993283b0e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.357008 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370654d-881c-49cb-aab4-b4993283b0e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.359672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370654d-881c-49cb-aab4-b4993283b0e1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9370654d-881c-49cb-aab4-b4993283b0e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:33.375043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:33.375967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:33.376927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:33.383034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 396/795] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:33.383034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370654d-881c-49cb-aab4-b4993283b0e1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.399918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0910459-ac41-497a-ae4c-99055cfb9606 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.436605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:33.444452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd936eb9-20c7-4181-bd08-6d77fe89c792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.445159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd936eb9-20c7-4181-bd08-6d77fe89c792 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.445676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd936eb9-20c7-4181-bd08-6d77fe89c792 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.445957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd936eb9-20c7-4181-bd08-6d77fe89c792 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.446674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd936eb9-20c7-4181-bd08-6d77fe89c792 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.448265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd936eb9-20c7-4181-bd08-6d77fe89c792 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.454411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:33.478863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 400/796] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:27:33 2022] POST /identity/v3/endpoints => generated 346 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:33.479901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd936eb9-20c7-4181-bd08-6d77fe89c792 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.508577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370654d-881c-49cb-aab4-b4993283b0e1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.555332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad6263-f63c-471c-b647-0cd1ca43bd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.556410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad6263-f63c-471c-b647-0cd1ca43bd9f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.556947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad6263-f63c-471c-b647-0cd1ca43bd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.557417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad6263-f63c-471c-b647-0cd1ca43bd9f None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.558351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad6263-f63c-471c-b647-0cd1ca43bd9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:33.558858 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad6263-f63c-471c-b647-0cd1ca43bd9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.560533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad6263-f63c-471c-b647-0cd1ca43bd9f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.570185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 397/797] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:33.577284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad6263-f63c-471c-b647-0cd1ca43bd9f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.604160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd936eb9-20c7-4181-bd08-6d77fe89c792 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.642201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0906cd-8dbd-4f2d-a703-87293d5c0760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.643174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0906cd-8dbd-4f2d-a703-87293d5c0760 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.644938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0906cd-8dbd-4f2d-a703-87293d5c0760 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.644938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0906cd-8dbd-4f2d-a703-87293d5c0760 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.645108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0906cd-8dbd-4f2d-a703-87293d5c0760 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:33.646130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0906cd-8dbd-4f2d-a703-87293d5c0760 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.647831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0906cd-8dbd-4f2d-a703-87293d5c0760 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.673732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 401/798] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:33.675067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1959a6-a5df-4030-bb62-6c3346b9a43d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.675348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1959a6-a5df-4030-bb62-6c3346b9a43d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.675620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1959a6-a5df-4030-bb62-6c3346b9a43d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.681083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 402/799] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:33.682044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1959a6-a5df-4030-bb62-6c3346b9a43d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.741653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:33.749627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:33.754535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad6263-f63c-471c-b647-0cd1ca43bd9f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.798387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4f9d7-0ae0-4cd3-92f9-0fec76e0a154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.799048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4f9d7-0ae0-4cd3-92f9-0fec76e0a154 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.799329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4f9d7-0ae0-4cd3-92f9-0fec76e0a154 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.799653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4f9d7-0ae0-4cd3-92f9-0fec76e0a154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.810726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1959a6-a5df-4030-bb62-6c3346b9a43d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.825384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4f9d7-0ae0-4cd3-92f9-0fec76e0a154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.827031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4f9d7-0ae0-4cd3-92f9-0fec76e0a154 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-2cb4f9d7-0ae0-4cd3-92f9-0fec76e0a154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:33.845908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:33.847511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:33.848403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:33.848403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:33.848403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:33.848403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:33.848403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 398/800] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:33.849489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d4fe-0531-401b-b574-2733bb6c91c4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.850056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d4fe-0531-401b-b574-2733bb6c91c4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.851708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d4fe-0531-401b-b574-2733bb6c91c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.855342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314abf-a41d-4512-a8fc-7d028919ec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.855988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314abf-a41d-4512-a8fc-7d028919ec29 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.856317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314abf-a41d-4512-a8fc-7d028919ec29 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.856600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314abf-a41d-4512-a8fc-7d028919ec29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.868789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d6e1d4fe-0531-401b-b574-2733bb6c91c4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:33.869351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90314abf-a41d-4512-a8fc-7d028919ec29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.870178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d6e1d4fe-0531-401b-b574-2733bb6c91c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:33.870877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90314abf-a41d-4512-a8fc-7d028919ec29 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-90314abf-a41d-4512-a8fc-7d028919ec29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:33.890138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:33.891692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:33.894854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:33.894854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:33.894854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:33.894854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:33.896246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 403/801] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:33.899071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314abf-a41d-4512-a8fc-7d028919ec29 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.963993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 399/802] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:33.965074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d4fe-0531-401b-b574-2733bb6c91c4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.016537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.020279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314abf-a41d-4512-a8fc-7d028919ec29 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.053204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883fa838-e02b-41a9-9329-48a7258ca4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.053812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fa838-e02b-41a9-9329-48a7258ca4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.054089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fa838-e02b-41a9-9329-48a7258ca4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.054359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883fa838-e02b-41a9-9329-48a7258ca4b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.055040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fa838-e02b-41a9-9329-48a7258ca4b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:34.055342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fa838-e02b-41a9-9329-48a7258ca4b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.055526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.056734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883fa838-e02b-41a9-9329-48a7258ca4b5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.068730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 404/803] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:34.069915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90477c-8917-47e1-9d52-e0a9633e7e4c None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.070197 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90477c-8917-47e1-9d52-e0a9633e7e4c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.070584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90477c-8917-47e1-9d52-e0a9633e7e4c None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.071929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 405/804] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:34.076342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90477c-8917-47e1-9d52-e0a9633e7e4c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.083137 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d4fe-0531-401b-b574-2733bb6c91c4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.120103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae29a8-78bb-404f-8acc-c4409a3da95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.120967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae29a8-78bb-404f-8acc-c4409a3da95a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.121077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae29a8-78bb-404f-8acc-c4409a3da95a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.121296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae29a8-78bb-404f-8acc-c4409a3da95a None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.122030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae29a8-78bb-404f-8acc-c4409a3da95a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:34.122283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae29a8-78bb-404f-8acc-c4409a3da95a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.123608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae29a8-78bb-404f-8acc-c4409a3da95a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.140121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 400/805] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:34.140121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae29a8-78bb-404f-8acc-c4409a3da95a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.181742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90477c-8917-47e1-9d52-e0a9633e7e4c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.216810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bef85b-4c9d-41a9-901c-eb442be273f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.217539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bef85b-4c9d-41a9-901c-eb442be273f3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.217706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bef85b-4c9d-41a9-901c-eb442be273f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.217993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bef85b-4c9d-41a9-901c-eb442be273f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.232408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bef85b-4c9d-41a9-901c-eb442be273f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-81bef85b-4c9d-41a9-901c-eb442be273f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:34.237992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:34.238899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:34.239749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 406/806] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:34.240448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abffe8-c7e0-4e2f-865a-81d5b368a338 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.241137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abffe8-c7e0-4e2f-865a-81d5b368a338 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.241137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abffe8-c7e0-4e2f-865a-81d5b368a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.250606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae29a8-78bb-404f-8acc-c4409a3da95a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.258939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-60abffe8-c7e0-4e2f-865a-81d5b368a338 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:34.260123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-60abffe8-c7e0-4e2f-865a-81d5b368a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:34.277558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.285951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75365545-1752-41b6-8b04-12cad8813a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.286593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365545-1752-41b6-8b04-12cad8813a38 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.286873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365545-1752-41b6-8b04-12cad8813a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.287144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75365545-1752-41b6-8b04-12cad8813a38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.294693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75365545-1752-41b6-8b04-12cad8813a38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.296190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75365545-1752-41b6-8b04-12cad8813a38 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.300890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-75365545-1752-41b6-8b04-12cad8813a38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:34.310985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:34.311944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 401/807] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:34.312896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75365545-1752-41b6-8b04-12cad8813a38 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.345883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 407/808] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:34.346921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abffe8-c7e0-4e2f-865a-81d5b368a338 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.424387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75365545-1752-41b6-8b04-12cad8813a38 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.456704 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abffe8-c7e0-4e2f-865a-81d5b368a338 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.458959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cd95b-cf8c-414f-88ec-c3eb8a00df21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.459595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd95b-cf8c-414f-88ec-c3eb8a00df21 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.459878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd95b-cf8c-414f-88ec-c3eb8a00df21 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.460169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd95b-cf8c-414f-88ec-c3eb8a00df21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.467083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cd95b-cf8c-414f-88ec-c3eb8a00df21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.468644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cd95b-cf8c-414f-88ec-c3eb8a00df21 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d24cd95b-cf8c-414f-88ec-c3eb8a00df21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:34.480314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:34.481173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:34.482061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:34.482061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:34.482061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:34.482061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:34.482061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:34.482061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:34.482061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:34.482061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:34.482061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 402/809] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:34.482547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cd95b-cf8c-414f-88ec-c3eb8a00df21 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.496379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bffaf-825a-4a7f-8929-b83188381ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.496991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bffaf-825a-4a7f-8929-b83188381ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.497270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bffaf-825a-4a7f-8929-b83188381ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.497540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7bffaf-825a-4a7f-8929-b83188381ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.498250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bffaf-825a-4a7f-8929-b83188381ac8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:34.498549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bffaf-825a-4a7f-8929-b83188381ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.499911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7bffaf-825a-4a7f-8929-b83188381ac8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.509111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 408/810] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:34.510186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bffaf-825a-4a7f-8929-b83188381ac8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.525258 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.552504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.595544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cd95b-cf8c-414f-88ec-c3eb8a00df21 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.618024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7bffaf-825a-4a7f-8929-b83188381ac8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.634452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b020-eb2f-43ea-accc-6e228e6fd3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.635060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b020-eb2f-43ea-accc-6e228e6fd3ec None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.635337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b020-eb2f-43ea-accc-6e228e6fd3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.635615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f6b020-eb2f-43ea-accc-6e228e6fd3ec None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.636422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6b020-eb2f-43ea-accc-6e228e6fd3ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:34.636729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6b020-eb2f-43ea-accc-6e228e6fd3ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.638180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f6b020-eb2f-43ea-accc-6e228e6fd3ec None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.652494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4966fd6-a4ac-4ab5-b5be-d53079aef1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.652774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4966fd6-a4ac-4ab5-b5be-d53079aef1de None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.653046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4966fd6-a4ac-4ab5-b5be-d53079aef1de None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.653316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4966fd6-a4ac-4ab5-b5be-d53079aef1de None admin] PATH_INFO: `/v3/services/network` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.653937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4966fd6-a4ac-4ab5-b5be-d53079aef1de None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.655541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4966fd6-a4ac-4ab5-b5be-d53079aef1de None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.661556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 403/811] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:34.661556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b020-eb2f-43ea-accc-6e228e6fd3ec None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b4966fd6-a4ac-4ab5-b5be-d53079aef1de None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:34.669443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:34.670399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:34.671246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 409/812] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:34.672001 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4966fd6-a4ac-4ab5-b5be-d53079aef1de None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.753219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.768188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f6b020-eb2f-43ea-accc-6e228e6fd3ec None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.778493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4966fd6-a4ac-4ab5-b5be-d53079aef1de None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.788646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.816191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c508f-7c79-4a91-805c-489448945807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.816814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c508f-7c79-4a91-805c-489448945807 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.817091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c508f-7c79-4a91-805c-489448945807 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.817364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c508f-7c79-4a91-805c-489448945807 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.818118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c508f-7c79-4a91-805c-489448945807 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:34.818421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c508f-7c79-4a91-805c-489448945807 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.819843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c508f-7c79-4a91-805c-489448945807 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.825124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd384390-492b-4f0f-8a1e-5e656f4e1906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.825761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384390-492b-4f0f-8a1e-5e656f4e1906 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.826091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384390-492b-4f0f-8a1e-5e656f4e1906 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.826368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd384390-492b-4f0f-8a1e-5e656f4e1906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.832427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 404/813] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:34.833155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c508f-7c79-4a91-805c-489448945807 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.843209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd384390-492b-4f0f-8a1e-5e656f4e1906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.844729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd384390-492b-4f0f-8a1e-5e656f4e1906 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-fd384390-492b-4f0f-8a1e-5e656f4e1906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:34.859371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:34.860833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:34.862718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:34.862718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:34.862718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:34.862718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:34.865714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 410/814] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:34.866389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd384390-492b-4f0f-8a1e-5e656f4e1906 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.943412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c508f-7c79-4a91-805c-489448945807 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.978712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd384390-492b-4f0f-8a1e-5e656f4e1906 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.979681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1dcc1-d86e-478f-8a72-3cfe24b1a707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.980341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1dcc1-d86e-478f-8a72-3cfe24b1a707 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.980616 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1dcc1-d86e-478f-8a72-3cfe24b1a707 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.980880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1dcc1-d86e-478f-8a72-3cfe24b1a707 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.992330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1dcc1-d86e-478f-8a72-3cfe24b1a707 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.993752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1dcc1-d86e-478f-8a72-3cfe24b1a707 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.006310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-69b1dcc1-d86e-478f-8a72-3cfe24b1a707 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:35.008555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:35.010244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:35.011305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:35.011305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:35.011305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:35.011305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:35.011305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 405/815] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:35.011305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1dcc1-d86e-478f-8a72-3cfe24b1a707 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.020516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d827b-458e-43dc-8678-170e4521ac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.021138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d827b-458e-43dc-8678-170e4521ac7f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.021418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d827b-458e-43dc-8678-170e4521ac7f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.021701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d827b-458e-43dc-8678-170e4521ac7f None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.022389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d827b-458e-43dc-8678-170e4521ac7f None admin] RBAC: Adding query filter params (name=network) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:35.022694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d827b-458e-43dc-8678-170e4521ac7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.024515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d827b-458e-43dc-8678-170e4521ac7f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.035186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 411/816] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:35.035918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d827b-458e-43dc-8678-170e4521ac7f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.045553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.119223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1dcc1-d86e-478f-8a72-3cfe24b1a707 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.137265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d827b-458e-43dc-8678-170e4521ac7f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.155218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec160fc-8430-4a93-ad84-961a52b8f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.155879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec160fc-8430-4a93-ad84-961a52b8f391 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.156177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec160fc-8430-4a93-ad84-961a52b8f391 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.156453 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec160fc-8430-4a93-ad84-961a52b8f391 None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/fa5d7ef1e1cd4185b3f0eb8215bf0dd6/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.158353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec160fc-8430-4a93-ad84-961a52b8f391 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.160540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec160fc-8430-4a93-ad84-961a52b8f391 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.172707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108172ed-a0c9-46f9-b9a3-5de56483745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.173326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108172ed-a0c9-46f9-b9a3-5de56483745f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.173599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108172ed-a0c9-46f9-b9a3-5de56483745f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.184552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108172ed-a0c9-46f9-b9a3-5de56483745f None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.184774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 406/817] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:35 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/fa5d7ef1e1cd4185b3f0eb8215bf0dd6/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:35.184860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108172ed-a0c9-46f9-b9a3-5de56483745f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:35.184930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec160fc-8430-4a93-ad84-961a52b8f391 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.185000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108172ed-a0c9-46f9-b9a3-5de56483745f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.185000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108172ed-a0c9-46f9-b9a3-5de56483745f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.202255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 412/818] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:35.203344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108172ed-a0c9-46f9-b9a3-5de56483745f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.276012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.332075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.335250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108172ed-a0c9-46f9-b9a3-5de56483745f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.344533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec160fc-8430-4a93-ad84-961a52b8f391 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.380045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b12859-459f-49a9-b2ef-eae31aa610cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.380724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b12859-459f-49a9-b2ef-eae31aa610cb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.381003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b12859-459f-49a9-b2ef-eae31aa610cb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.381275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b12859-459f-49a9-b2ef-eae31aa610cb None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.381953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b12859-459f-49a9-b2ef-eae31aa610cb None admin] RBAC: Adding query filter params (type=network) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:35.382257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b12859-459f-49a9-b2ef-eae31aa610cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.383629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b12859-459f-49a9-b2ef-eae31aa610cb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.387829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b7ae-d9cc-4a29-a60a-fc11e35a0141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.388552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b7ae-d9cc-4a29-a60a-fc11e35a0141 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.388670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b7ae-d9cc-4a29-a60a-fc11e35a0141 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.389224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70b7ae-d9cc-4a29-a60a-fc11e35a0141 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.389770 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70b7ae-d9cc-4a29-a60a-fc11e35a0141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:35.389880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 413/819] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:35.389956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70b7ae-d9cc-4a29-a60a-fc11e35a0141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.390805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b12859-459f-49a9-b2ef-eae31aa610cb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.391267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c70b7ae-d9cc-4a29-a60a-fc11e35a0141 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.407375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 407/820] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:35.408233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b7ae-d9cc-4a29-a60a-fc11e35a0141 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.498306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b12859-459f-49a9-b2ef-eae31aa610cb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.514900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70b7ae-d9cc-4a29-a60a-fc11e35a0141 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.515552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.535223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333b92f-d039-4473-a1fd-30d17b370f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.535888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333b92f-d039-4473-a1fd-30d17b370f43 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.536194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333b92f-d039-4473-a1fd-30d17b370f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.536479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333b92f-d039-4473-a1fd-30d17b370f43 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.545675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333b92f-d039-4473-a1fd-30d17b370f43 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.547667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333b92f-d039-4473-a1fd-30d17b370f43 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.558059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d919d-5502-4b57-8eb8-62a2ed3270e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.558781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d919d-5502-4b57-8eb8-62a2ed3270e1 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.559138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d919d-5502-4b57-8eb8-62a2ed3270e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.559476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d919d-5502-4b57-8eb8-62a2ed3270e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.560289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d919d-5502-4b57-8eb8-62a2ed3270e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.561701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d919d-5502-4b57-8eb8-62a2ed3270e1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-2333b92f-d039-4473-a1fd-30d17b370f43 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:35.561958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:35.562850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:35.563743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 414/821] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:35.564340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333b92f-d039-4473-a1fd-30d17b370f43 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.591123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 408/822] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:27:35 2022] POST /identity/v3/endpoints => generated 337 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:35.598924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d919d-5502-4b57-8eb8-62a2ed3270e1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.616727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.748990 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333b92f-d039-4473-a1fd-30d17b370f43 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.771177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d919d-5502-4b57-8eb8-62a2ed3270e1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.806677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4301265-2181-4f8e-88a7-28d9101b0e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.807644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301265-2181-4f8e-88a7-28d9101b0e2a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.807933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301265-2181-4f8e-88a7-28d9101b0e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.808263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4301265-2181-4f8e-88a7-28d9101b0e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.817360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4301265-2181-4f8e-88a7-28d9101b0e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.818246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bd064-fd62-4c99-9690-9eb99bf83a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.818871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4301265-2181-4f8e-88a7-28d9101b0e2a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.819734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd064-fd62-4c99-9690-9eb99bf83a26 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.820016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd064-fd62-4c99-9690-9eb99bf83a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.820318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bd064-fd62-4c99-9690-9eb99bf83a26 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.821121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bd064-fd62-4c99-9690-9eb99bf83a26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:35.821426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bd064-fd62-4c99-9690-9eb99bf83a26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.822853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bd064-fd62-4c99-9690-9eb99bf83a26 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-e4301265-2181-4f8e-88a7-28d9101b0e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:35.834064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:35.834973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:35.836563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:35.836563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:35.836563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:35.836563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:35.836563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:35.836563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:35.836563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:35.836563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:35.836563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 415/823] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:35.837034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24125283-e95f-429a-98cb-d69bcca288aa None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.837100 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24125283-e95f-429a-98cb-d69bcca288aa None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.837829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24125283-e95f-429a-98cb-d69bcca288aa None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.839218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 416/824] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:35.840972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 409/825] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:35.843646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24125283-e95f-429a-98cb-d69bcca288aa None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.846711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9252-7800-4593-adee-60a75943c009 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.846999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9252-7800-4593-adee-60a75943c009 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.847277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad9252-7800-4593-adee-60a75943c009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.867814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b3ad9252-7800-4593-adee-60a75943c009 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:35.869144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b3ad9252-7800-4593-adee-60a75943c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:35.888330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.936852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.950263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 410/826] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:35.951285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9252-7800-4593-adee-60a75943c009 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.978450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24125283-e95f-429a-98cb-d69bcca288aa None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.015815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90defa-d8ec-4f8f-8fb7-fc2e9850c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.016459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90defa-d8ec-4f8f-8fb7-fc2e9850c47f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.016743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90defa-d8ec-4f8f-8fb7-fc2e9850c47f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.017014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90defa-d8ec-4f8f-8fb7-fc2e9850c47f None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.017769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90defa-d8ec-4f8f-8fb7-fc2e9850c47f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:36.018072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90defa-d8ec-4f8f-8fb7-fc2e9850c47f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.019534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90defa-d8ec-4f8f-8fb7-fc2e9850c47f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.036487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 417/827] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:36.036487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90defa-d8ec-4f8f-8fb7-fc2e9850c47f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:36.060051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad9252-7800-4593-adee-60a75943c009 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.094955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d437f02-5277-47c8-b326-9310915f6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.095592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d437f02-5277-47c8-b326-9310915f6679 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.095871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d437f02-5277-47c8-b326-9310915f6679 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.096163 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d437f02-5277-47c8-b326-9310915f6679 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.135149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:36.142453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90defa-d8ec-4f8f-8fb7-fc2e9850c47f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.155595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:36.167218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d437f02-5277-47c8-b326-9310915f6679 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.168698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d437f02-5277-47c8-b326-9310915f6679 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.178895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a591ee4-8d2b-42ee-bae4-4d9ed9fb5919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.179534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a591ee4-8d2b-42ee-bae4-4d9ed9fb5919 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.179814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a591ee4-8d2b-42ee-bae4-4d9ed9fb5919 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.180088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a591ee4-8d2b-42ee-bae4-4d9ed9fb5919 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.180748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a591ee4-8d2b-42ee-bae4-4d9ed9fb5919 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.182097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a591ee4-8d2b-42ee-bae4-4d9ed9fb5919 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-2a591ee4-8d2b-42ee-bae4-4d9ed9fb5919 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:36.190917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:36.191842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:36.192693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 418/828] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:36.193468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a591ee4-8d2b-42ee-bae4-4d9ed9fb5919 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:36.289223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 411/829] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:27:36.290094 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d437f02-5277-47c8-b326-9310915f6679 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:36.299388 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a591ee4-8d2b-42ee-bae4-4d9ed9fb5919 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.344809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc291a-b380-4733-bab5-00817611acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.345124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc291a-b380-4733-bab5-00817611acf2 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.345405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc291a-b380-4733-bab5-00817611acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.345635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc291a-b380-4733-bab5-00817611acf2 None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/31a94e98e1b2499f8417dd10d00e780e/roles/78cbd44006c3419d916364b7251b1ae4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.361443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc291a-b380-4733-bab5-00817611acf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=31a94e98e1b2499f8417dd10d00e780e, role_id=78cbd44006c3419d916364b7251b1ae4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.363463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc291a-b380-4733-bab5-00817611acf2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.384179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 419/830] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:36 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/31a94e98e1b2499f8417dd10d00e780e/roles/78cbd44006c3419d916364b7251b1ae4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:36.384179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc291a-b380-4733-bab5-00817611acf2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:36.397589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:36.415900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:36.432466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d437f02-5277-47c8-b326-9310915f6679 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.486123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89aff4-0ad9-4e7c-b7f8-b32c9b8fdb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.486823 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89aff4-0ad9-4e7c-b7f8-b32c9b8fdb0e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.487659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89aff4-0ad9-4e7c-b7f8-b32c9b8fdb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.487935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89aff4-0ad9-4e7c-b7f8-b32c9b8fdb0e None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.488656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89aff4-0ad9-4e7c-b7f8-b32c9b8fdb0e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:36.489519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89aff4-0ad9-4e7c-b7f8-b32c9b8fdb0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.491391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89aff4-0ad9-4e7c-b7f8-b32c9b8fdb0e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.502694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 412/831] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:36.504013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89aff4-0ad9-4e7c-b7f8-b32c9b8fdb0e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:36.523134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc291a-b380-4733-bab5-00817611acf2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.565574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f507bb-954e-4efe-ba6d-9739ccc22060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.566983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f507bb-954e-4efe-ba6d-9739ccc22060 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.567704 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f507bb-954e-4efe-ba6d-9739ccc22060 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.568186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f507bb-954e-4efe-ba6d-9739ccc22060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.582713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f507bb-954e-4efe-ba6d-9739ccc22060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.584313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f507bb-954e-4efe-ba6d-9739ccc22060 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-a2f507bb-954e-4efe-ba6d-9739ccc22060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:36.606084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:36.606952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:36.607817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:36.607817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:36.607817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:36.607817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:36.607817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 420/832] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:36.613337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f507bb-954e-4efe-ba6d-9739ccc22060 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:36.630043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89aff4-0ad9-4e7c-b7f8-b32c9b8fdb0e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.680245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1f41a-2200-46f5-98b8-e19ac42d0787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.681205 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1f41a-2200-46f5-98b8-e19ac42d0787 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.681624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1f41a-2200-46f5-98b8-e19ac42d0787 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.682062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1f41a-2200-46f5-98b8-e19ac42d0787 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.682900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1f41a-2200-46f5-98b8-e19ac42d0787 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:36.683343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1f41a-2200-46f5-98b8-e19ac42d0787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.685073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1f41a-2200-46f5-98b8-e19ac42d0787 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.690145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:36.691875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 413/833] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:36 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:36.747041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f507bb-954e-4efe-ba6d-9739ccc22060 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.788280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be57b00-154c-4944-b71e-46e49667034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.789555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57b00-154c-4944-b71e-46e49667034b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.790256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57b00-154c-4944-b71e-46e49667034b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.790947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be57b00-154c-4944-b71e-46e49667034b None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.792269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be57b00-154c-4944-b71e-46e49667034b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:36.792729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be57b00-154c-4944-b71e-46e49667034b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.795795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be57b00-154c-4944-b71e-46e49667034b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.812892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 421/834] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:36.821337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1f41a-2200-46f5-98b8-e19ac42d0787 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:36.843880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:36.935174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1f41a-2200-46f5-98b8-e19ac42d0787 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.972606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864165a-fa31-496e-9acc-f09184cb73dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.973549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864165a-fa31-496e-9acc-f09184cb73dd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.974030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864165a-fa31-496e-9acc-f09184cb73dd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.974474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864165a-fa31-496e-9acc-f09184cb73dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.981678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864165a-fa31-496e-9acc-f09184cb73dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.983315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864165a-fa31-496e-9acc-f09184cb73dd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5864165a-fa31-496e-9acc-f09184cb73dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:36.995134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:36.996062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:36.996960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:36.996960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:36.996960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:36.996960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:36.996960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:36.996960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:36.996960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:36.996960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:36.999085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 414/835] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:37.005437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be57b00-154c-4944-b71e-46e49667034b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.112681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be57b00-154c-4944-b71e-46e49667034b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.136300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:37.149930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fd18d-0bc2-4510-8784-925fabf5cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.150545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fd18d-0bc2-4510-8784-925fabf5cf6f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.150824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fd18d-0bc2-4510-8784-925fabf5cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.151096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fd18d-0bc2-4510-8784-925fabf5cf6f None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.151851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fd18d-0bc2-4510-8784-925fabf5cf6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:37.152170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fd18d-0bc2-4510-8784-925fabf5cf6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:37.153612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455fd18d-0bc2-4510-8784-925fabf5cf6f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:37.166849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 422/836] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:37.172766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864165a-fa31-496e-9acc-f09184cb73dd None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.258304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:37.281250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864165a-fa31-496e-9acc-f09184cb73dd None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.301743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35126-7e70-46f1-9dfd-b86e2c1f4ccd None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.302050 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35126-7e70-46f1-9dfd-b86e2c1f4ccd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.302295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35126-7e70-46f1-9dfd-b86e2c1f4ccd None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.303875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 423/837] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:37.308742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503973bc-b83a-4543-a6a2-41ce6cff1b83 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.309024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503973bc-b83a-4543-a6a2-41ce6cff1b83 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.309298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503973bc-b83a-4543-a6a2-41ce6cff1b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.321106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb1d89-df69-4d39-a92c-6786bdc298c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.321729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb1d89-df69-4d39-a92c-6786bdc298c9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.322035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb1d89-df69-4d39-a92c-6786bdc298c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.322392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb1d89-df69-4d39-a92c-6786bdc298c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.323183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb1d89-df69-4d39-a92c-6786bdc298c9 None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=cab044fcd0dd449eafaccb81606d15ce) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:37.323491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb1d89-df69-4d39-a92c-6786bdc298c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:37.324935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb1d89-df69-4d39-a92c-6786bdc298c9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:37.329009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-503973bc-b83a-4543-a6a2-41ce6cff1b83 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:37.330455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-503973bc-b83a-4543-a6a2-41ce6cff1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:37.331391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 415/838] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/role_assignments?user.id=cab044fcd0dd449eafaccb81606d15ce&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:37.409458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 424/839] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:37 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:27:37.432645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb1d89-df69-4d39-a92c-6786bdc298c9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.542057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb1d89-df69-4d39-a92c-6786bdc298c9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.579708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185105c-b494-4bb8-83f6-94fece6c4e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.580374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185105c-b494-4bb8-83f6-94fece6c4e97 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.580688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185105c-b494-4bb8-83f6-94fece6c4e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.580961 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185105c-b494-4bb8-83f6-94fece6c4e97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.591794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185105c-b494-4bb8-83f6-94fece6c4e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a185105c-b494-4bb8-83f6-94fece6c4e97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:37.597690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:37.599166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:37.599986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 416/840] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:37.607287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503973bc-b83a-4543-a6a2-41ce6cff1b83 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.708733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503973bc-b83a-4543-a6a2-41ce6cff1b83 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.724458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:37.744275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa5e13-7b7b-4975-a7cd-d955e14650e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.745192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5e13-7b7b-4975-a7cd-d955e14650e7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.745470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5e13-7b7b-4975-a7cd-d955e14650e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.745741 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa5e13-7b7b-4975-a7cd-d955e14650e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.746454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa5e13-7b7b-4975-a7cd-d955e14650e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:37.746754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa5e13-7b7b-4975-a7cd-d955e14650e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:37.748113 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa5e13-7b7b-4975-a7cd-d955e14650e7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:37.757042 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 425/841] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:37.765225 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185105c-b494-4bb8-83f6-94fece6c4e97 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.768571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:37.882577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185105c-b494-4bb8-83f6-94fece6c4e97 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.917640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498d6e5-1ab5-4f41-a61c-b4b31102cf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.918301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498d6e5-1ab5-4f41-a61c-b4b31102cf65 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.918582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498d6e5-1ab5-4f41-a61c-b4b31102cf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.918857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498d6e5-1ab5-4f41-a61c-b4b31102cf65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.931830 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498d6e5-1ab5-4f41-a61c-b4b31102cf65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:37.933357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498d6e5-1ab5-4f41-a61c-b4b31102cf65 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-0498d6e5-1ab5-4f41-a61c-b4b31102cf65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:37.948973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:37.949940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:37.950902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:37.950902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:37.950902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:37.950902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:37.950902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 417/842] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:37.956476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa5e13-7b7b-4975-a7cd-d955e14650e7 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:38.060741 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa5e13-7b7b-4975-a7cd-d955e14650e7 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:38.094744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632ef0-bbee-4fd7-b4aa-3ef607d3d488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:38.095356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632ef0-bbee-4fd7-b4aa-3ef607d3d488 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.095632 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632ef0-bbee-4fd7-b4aa-3ef607d3d488 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.095900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632ef0-bbee-4fd7-b4aa-3ef607d3d488 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.097239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5632ef0-bbee-4fd7-b4aa-3ef607d3d488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:38.097598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5632ef0-bbee-4fd7-b4aa-3ef607d3d488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:38.098963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5632ef0-bbee-4fd7-b4aa-3ef607d3d488 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:38.111023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 426/843] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:38.116335 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498d6e5-1ab5-4f41-a61c-b4b31102cf65 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:38.192513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:38.224882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498d6e5-1ab5-4f41-a61c-b4b31102cf65 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:38.258404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08867461-5601-4221-9ea1-a2e3c6314dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:38.259044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08867461-5601-4221-9ea1-a2e3c6314dab None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.259322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08867461-5601-4221-9ea1-a2e3c6314dab None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.259595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08867461-5601-4221-9ea1-a2e3c6314dab None admin] PATH_INFO: `/v3/users/swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.268818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08867461-5601-4221-9ea1-a2e3c6314dab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:38.270241 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08867461-5601-4221-9ea1-a2e3c6314dab None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-08867461-5601-4221-9ea1-a2e3c6314dab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:38.281812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:38.282754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:38.283757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 418/844] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:38.289328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632ef0-bbee-4fd7-b4aa-3ef607d3d488 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:38.323006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:38.395069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632ef0-bbee-4fd7-b4aa-3ef607d3d488 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:38.431724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba4785-ade1-453c-871b-0028841f1af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:38.432375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4785-ade1-453c-871b-0028841f1af2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.432659 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4785-ade1-453c-871b-0028841f1af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.432931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba4785-ade1-453c-871b-0028841f1af2 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.433725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba4785-ade1-453c-871b-0028841f1af2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:38.434036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba4785-ade1-453c-871b-0028841f1af2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:38.435617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba4785-ade1-453c-871b-0028841f1af2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:38.454360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 427/845] 10.222.0.57 () {56 vars in 1135 bytes} [Tue Aug 2 21:27:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:38.460091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08867461-5601-4221-9ea1-a2e3c6314dab None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:38.556014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb786f8-b4b2-4456-bad0-95150e8628f7 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.556330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb786f8-b4b2-4456-bad0-95150e8628f7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.556607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb786f8-b4b2-4456-bad0-95150e8628f7 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.558067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 428/846] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:38.565567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbedd4c-e34f-4d24-9d19-8af119857653 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.565729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08867461-5601-4221-9ea1-a2e3c6314dab None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:38.565925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbedd4c-e34f-4d24-9d19-8af119857653 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.566107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbedd4c-e34f-4d24-9d19-8af119857653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.586460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:38.592327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ecbedd4c-e34f-4d24-9d19-8af119857653 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:38.593678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ecbedd4c-e34f-4d24-9d19-8af119857653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:38.610379 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86c540-6cfe-4c35-b68d-f1d2f10fdd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:38.611342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86c540-6cfe-4c35-b68d-f1d2f10fdd88 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.611624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86c540-6cfe-4c35-b68d-f1d2f10fdd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.611931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f86c540-6cfe-4c35-b68d-f1d2f10fdd88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.676281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 429/847] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:27:38.698474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbedd4c-e34f-4d24-9d19-8af119857653 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:38.699214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86c540-6cfe-4c35-b68d-f1d2f10fdd88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:38.701091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f86c540-6cfe-4c35-b68d-f1d2f10fdd88 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:38.728077 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:38.824596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 419/848] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:38 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:27:38.830133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86c540-6cfe-4c35-b68d-f1d2f10fdd88 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:38.847242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbedd4c-e34f-4d24-9d19-8af119857653 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:38.848120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:38.893026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c9f346-f038-45a8-bb90-d53b3f8819e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:38.893681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9f346-f038-45a8-bb90-d53b3f8819e0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.893962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9f346-f038-45a8-bb90-d53b3f8819e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.894234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c9f346-f038-45a8-bb90-d53b3f8819e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.904992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c9f346-f038-45a8-bb90-d53b3f8819e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-51c9f346-f038-45a8-bb90-d53b3f8819e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:38.910176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:38.911107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:38.911905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 430/849] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:38.912608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3db8c-6989-4f5d-bf75-44c71413e11d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.912999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3db8c-6989-4f5d-bf75-44c71413e11d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.913108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3db8c-6989-4f5d-bf75-44c71413e11d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.917024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 431/850] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:38.917995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3db8c-6989-4f5d-bf75-44c71413e11d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:38.943810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f86c540-6cfe-4c35-b68d-f1d2f10fdd88 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:38.978609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856723a-7699-4d5c-bc50-2aad384856dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:38.979253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856723a-7699-4d5c-bc50-2aad384856dc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.979535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856723a-7699-4d5c-bc50-2aad384856dc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.979810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856723a-7699-4d5c-bc50-2aad384856dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.992868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856723a-7699-4d5c-bc50-2aad384856dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:38.994302 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856723a-7699-4d5c-bc50-2aad384856dc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c856723a-7699-4d5c-bc50-2aad384856dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:39.009478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:39.010362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:39.012556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:39.012556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:39.012556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:39.012556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:39.012556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 420/851] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:39.012556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc55a74-ba38-4590-872d-49a3a619d64a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.012556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc55a74-ba38-4590-872d-49a3a619d64a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.012556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc55a74-ba38-4590-872d-49a3a619d64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.020286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.031436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4cc55a74-ba38-4590-872d-49a3a619d64a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:39.032851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4cc55a74-ba38-4590-872d-49a3a619d64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:39.043440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3db8c-6989-4f5d-bf75-44c71413e11d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.078314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf2582-77c9-43b8-bbc1-1e348fba21e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.078931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf2582-77c9-43b8-bbc1-1e348fba21e8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.079223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf2582-77c9-43b8-bbc1-1e348fba21e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.079495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf2582-77c9-43b8-bbc1-1e348fba21e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.080244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf2582-77c9-43b8-bbc1-1e348fba21e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:39.080570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf2582-77c9-43b8-bbc1-1e348fba21e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.081938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf2582-77c9-43b8-bbc1-1e348fba21e8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.089842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 432/852] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:39.090712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf2582-77c9-43b8-bbc1-1e348fba21e8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.097985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.107391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 421/853] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:39.108299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc55a74-ba38-4590-872d-49a3a619d64a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.208267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf2582-77c9-43b8-bbc1-1e348fba21e8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.217749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc55a74-ba38-4590-872d-49a3a619d64a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.245460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81adf00-fe85-4df4-aafe-0affa358d403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.246130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81adf00-fe85-4df4-aafe-0affa358d403 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.246415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81adf00-fe85-4df4-aafe-0affa358d403 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.246688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81adf00-fe85-4df4-aafe-0affa358d403 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.247500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81adf00-fe85-4df4-aafe-0affa358d403 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:39.247919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81adf00-fe85-4df4-aafe-0affa358d403 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.249418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81adf00-fe85-4df4-aafe-0affa358d403 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.252609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec480-eb2d-4f78-adf1-d74441a6477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.253249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec480-eb2d-4f78-adf1-d74441a6477e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.253527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec480-eb2d-4f78-adf1-d74441a6477e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.253797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ec480-eb2d-4f78-adf1-d74441a6477e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.267227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 433/854] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:39.267227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81adf00-fe85-4df4-aafe-0affa358d403 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.270459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.270600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ec480-eb2d-4f78-adf1-d74441a6477e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.272037 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ec480-eb2d-4f78-adf1-d74441a6477e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c86ec480-eb2d-4f78-adf1-d74441a6477e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:39.289142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:39.290066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:39.290958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:39.290958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:39.290958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:39.290958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:39.290958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 422/855] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:39.291234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec480-eb2d-4f78-adf1-d74441a6477e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.344826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.373678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81adf00-fe85-4df4-aafe-0affa358d403 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.400624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ec480-eb2d-4f78-adf1-d74441a6477e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.410524 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54c190-547c-42aa-8840-dfdb5c25d7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.411337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54c190-547c-42aa-8840-dfdb5c25d7db None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.412095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54c190-547c-42aa-8840-dfdb5c25d7db None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.412847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54c190-547c-42aa-8840-dfdb5c25d7db None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.413685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54c190-547c-42aa-8840-dfdb5c25d7db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.415873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54c190-547c-42aa-8840-dfdb5c25d7db None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.432409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 434/856] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:27:39 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:39.433552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54c190-547c-42aa-8840-dfdb5c25d7db None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.456674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073631c-97e6-4d3d-9f1a-f7f2ce12bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.457522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073631c-97e6-4d3d-9f1a-f7f2ce12bb55 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.457912 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073631c-97e6-4d3d-9f1a-f7f2ce12bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.458277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073631c-97e6-4d3d-9f1a-f7f2ce12bb55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.468976 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073631c-97e6-4d3d-9f1a-f7f2ce12bb55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.470949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073631c-97e6-4d3d-9f1a-f7f2ce12bb55 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-0073631c-97e6-4d3d-9f1a-f7f2ce12bb55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:39.486211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:39.487932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:39.489003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:39.489003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:39.489003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:39.489003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:39.489003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:39.489003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:39.489003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:39.489003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:39.495747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 423/857] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:39.497246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073631c-97e6-4d3d-9f1a-f7f2ce12bb55 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.521638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.568287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54c190-547c-42aa-8840-dfdb5c25d7db None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.610171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e7741-6613-4cf3-9d9a-3ef7bc77639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.610803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e7741-6613-4cf3-9d9a-3ef7bc77639b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.611233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e7741-6613-4cf3-9d9a-3ef7bc77639b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.611506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e7741-6613-4cf3-9d9a-3ef7bc77639b None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.612277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e7741-6613-4cf3-9d9a-3ef7bc77639b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:39.612594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e7741-6613-4cf3-9d9a-3ef7bc77639b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.614107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3e7741-6613-4cf3-9d9a-3ef7bc77639b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.617049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073631c-97e6-4d3d-9f1a-f7f2ce12bb55 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.619960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.628357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 435/858] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:39.629409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7e249-0d7d-4a69-b9d5-018df7919d51 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.629692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7e249-0d7d-4a69-b9d5-018df7919d51 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.629960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7e249-0d7d-4a69-b9d5-018df7919d51 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.631520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 436/859] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:39.635796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7e249-0d7d-4a69-b9d5-018df7919d51 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.660988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56232da5-bd6b-49af-98c2-fa3ec76ab3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.661728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232da5-bd6b-49af-98c2-fa3ec76ab3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.662013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232da5-bd6b-49af-98c2-fa3ec76ab3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.662404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56232da5-bd6b-49af-98c2-fa3ec76ab3f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.663157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56232da5-bd6b-49af-98c2-fa3ec76ab3f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:39.663462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56232da5-bd6b-49af-98c2-fa3ec76ab3f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.665039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56232da5-bd6b-49af-98c2-fa3ec76ab3f0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.678101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 424/860] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:39.679315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f10eb5-1e0d-481d-acb9-e2b6efb4c4bd None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.679601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f10eb5-1e0d-481d-acb9-e2b6efb4c4bd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.679873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f10eb5-1e0d-481d-acb9-e2b6efb4c4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.697601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-68f10eb5-1e0d-481d-acb9-e2b6efb4c4bd None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:39.698796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-68f10eb5-1e0d-481d-acb9-e2b6efb4c4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:39.745459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7e249-0d7d-4a69-b9d5-018df7919d51 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.769062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 425/861] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:39 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:39.772457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f10eb5-1e0d-481d-acb9-e2b6efb4c4bd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.774825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.790066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475403c-4622-428e-af7f-020dd5504444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.790711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475403c-4622-428e-af7f-020dd5504444 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.790989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475403c-4622-428e-af7f-020dd5504444 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.791307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475403c-4622-428e-af7f-020dd5504444 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.799675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475403c-4622-428e-af7f-020dd5504444 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.801285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475403c-4622-428e-af7f-020dd5504444 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-d475403c-4622-428e-af7f-020dd5504444 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:39.816426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:39.817568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:39.818702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:39.820106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 437/862] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:39.820812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475403c-4622-428e-af7f-020dd5504444 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.887641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.896671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f10eb5-1e0d-481d-acb9-e2b6efb4c4bd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.925649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475403c-4622-428e-af7f-020dd5504444 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.935006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b8c8e-dda5-4822-80cd-596baec9a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.935634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b8c8e-dda5-4822-80cd-596baec9a61d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.935916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b8c8e-dda5-4822-80cd-596baec9a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.936213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b8c8e-dda5-4822-80cd-596baec9a61d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.937005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b8c8e-dda5-4822-80cd-596baec9a61d None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:39.937318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b8c8e-dda5-4822-80cd-596baec9a61d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.938774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b8c8e-dda5-4822-80cd-596baec9a61d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.956174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 426/863] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/role_assignments?user.id=fa5d7ef1e1cd4185b3f0eb8215bf0dd6&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:39.956174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b8c8e-dda5-4822-80cd-596baec9a61d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.961948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee613-392f-4967-8013-32e79f5da16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.962605 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee613-392f-4967-8013-32e79f5da16f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.962888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee613-392f-4967-8013-32e79f5da16f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.963164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee613-392f-4967-8013-32e79f5da16f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.963803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bee613-392f-4967-8013-32e79f5da16f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:39.965287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bee613-392f-4967-8013-32e79f5da16f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-49bee613-392f-4967-8013-32e79f5da16f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:39.974983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:39.976201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:39.977053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 438/864] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:39.983236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee613-392f-4967-8013-32e79f5da16f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.042210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.089865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b8c8e-dda5-4822-80cd-596baec9a61d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.097700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee613-392f-4967-8013-32e79f5da16f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.126433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25742b-da9c-479a-ad0e-a7eb5f07f904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.128258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25742b-da9c-479a-ad0e-a7eb5f07f904 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.128723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25742b-da9c-479a-ad0e-a7eb5f07f904 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.129173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25742b-da9c-479a-ad0e-a7eb5f07f904 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.130161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25742b-da9c-479a-ad0e-a7eb5f07f904 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:40.130658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25742b-da9c-479a-ad0e-a7eb5f07f904 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:40.132603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25742b-da9c-479a-ad0e-a7eb5f07f904 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:40.138884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0d7bd-1172-4ea9-accf-abd746538d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.140179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0d7bd-1172-4ea9-accf-abd746538d9b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.140179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0d7bd-1172-4ea9-accf-abd746538d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.140179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0d7bd-1172-4ea9-accf-abd746538d9b None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.140694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0d7bd-1172-4ea9-accf-abd746538d9b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:40.141002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0d7bd-1172-4ea9-accf-abd746538d9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:40.142393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0d7bd-1172-4ea9-accf-abd746538d9b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:40.148414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 439/865] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:40.155087 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 427/866] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:40.155940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0d7bd-1172-4ea9-accf-abd746538d9b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.160828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25742b-da9c-479a-ad0e-a7eb5f07f904 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.179339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.275263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0d7bd-1172-4ea9-accf-abd746538d9b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.288260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.291609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25742b-da9c-479a-ad0e-a7eb5f07f904 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.313056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362266c-bc3c-4da9-9572-bf77643fa9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.313681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362266c-bc3c-4da9-9572-bf77643fa9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.313966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362266c-bc3c-4da9-9572-bf77643fa9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.314277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362266c-bc3c-4da9-9572-bf77643fa9c1 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.315957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362266c-bc3c-4da9-9572-bf77643fa9c1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:40.316312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362266c-bc3c-4da9-9572-bf77643fa9c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:40.317699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362266c-bc3c-4da9-9572-bf77643fa9c1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:40.329322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 440/867] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:40.339496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f1dad-781d-425a-bc47-2b01c31ce85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.340155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f1dad-781d-425a-bc47-2b01c31ce85b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.340446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f1dad-781d-425a-bc47-2b01c31ce85b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.340718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f1dad-781d-425a-bc47-2b01c31ce85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.421355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f1dad-781d-425a-bc47-2b01c31ce85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:40.422749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f1dad-781d-425a-bc47-2b01c31ce85b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:40.443051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.534677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 428/868] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:27:40.540150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362266c-bc3c-4da9-9572-bf77643fa9c1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.646656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362266c-bc3c-4da9-9572-bf77643fa9c1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.682063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b28712-a1ca-427f-b800-b95a72958688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.683028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b28712-a1ca-427f-b800-b95a72958688 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.683537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b28712-a1ca-427f-b800-b95a72958688 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.684001 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b28712-a1ca-427f-b800-b95a72958688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.694941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b28712-a1ca-427f-b800-b95a72958688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:40.696676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b28712-a1ca-427f-b800-b95a72958688 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-05b28712-a1ca-427f-b800-b95a72958688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:40.711136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:40.712023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:40.712913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:40.712913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:40.712913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:40.712913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:40.715102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 441/869] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:40.721857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f1dad-781d-425a-bc47-2b01c31ce85b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.838809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f1dad-781d-425a-bc47-2b01c31ce85b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.856430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.875201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4257e-e7a9-4079-b99b-fe1aa709c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.875816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4257e-e7a9-4079-b99b-fe1aa709c75d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.876097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4257e-e7a9-4079-b99b-fe1aa709c75d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.876400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4257e-e7a9-4079-b99b-fe1aa709c75d None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.877086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4257e-e7a9-4079-b99b-fe1aa709c75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:40.877425 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4257e-e7a9-4079-b99b-fe1aa709c75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:40.878779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4257e-e7a9-4079-b99b-fe1aa709c75d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:40.890738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 429/870] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:40.896444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b28712-a1ca-427f-b800-b95a72958688 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.926972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.001299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b28712-a1ca-427f-b800-b95a72958688 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.036986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89286-eda3-4d4e-9743-8bdbb2882200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.037966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89286-eda3-4d4e-9743-8bdbb2882200 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.038458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89286-eda3-4d4e-9743-8bdbb2882200 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.038941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89286-eda3-4d4e-9743-8bdbb2882200 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.046101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89286-eda3-4d4e-9743-8bdbb2882200 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.047784 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89286-eda3-4d4e-9743-8bdbb2882200 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7bb89286-eda3-4d4e-9743-8bdbb2882200 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:41.060157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:41.061033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:41.061890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:41.061890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:41.061890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:41.061890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:41.061890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:41.061890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:41.061890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:41.061890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:41.068233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 442/871] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:41.073215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4257e-e7a9-4079-b99b-fe1aa709c75d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.177717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4257e-e7a9-4079-b99b-fe1aa709c75d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.215009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b67543-ca1e-4a7d-bb88-b595d09f75e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.216023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b67543-ca1e-4a7d-bb88-b595d09f75e9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.216522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b67543-ca1e-4a7d-bb88-b595d09f75e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.217010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b67543-ca1e-4a7d-bb88-b595d09f75e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.217964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b67543-ca1e-4a7d-bb88-b595d09f75e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:41.218565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b67543-ca1e-4a7d-bb88-b595d09f75e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.220182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b67543-ca1e-4a7d-bb88-b595d09f75e9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.234999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 430/872] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:41.241389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89286-eda3-4d4e-9743-8bdbb2882200 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.333049 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.345638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89286-eda3-4d4e-9743-8bdbb2882200 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.381079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39608db3-3dd8-4c9b-bd75-05c4808aeeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.382043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39608db3-3dd8-4c9b-bd75-05c4808aeeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.382537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39608db3-3dd8-4c9b-bd75-05c4808aeeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.383001 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39608db3-3dd8-4c9b-bd75-05c4808aeeb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.383995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39608db3-3dd8-4c9b-bd75-05c4808aeeb8 None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=31a94e98e1b2499f8417dd10d00e780e) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:41.384517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39608db3-3dd8-4c9b-bd75-05c4808aeeb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.386198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39608db3-3dd8-4c9b-bd75-05c4808aeeb8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.392824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 443/873] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/role_assignments?user.id=31a94e98e1b2499f8417dd10d00e780e&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:41.533699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962003fc-9ca3-4b50-a112-5fe761cf4448 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.534243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962003fc-9ca3-4b50-a112-5fe761cf4448 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.534243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962003fc-9ca3-4b50-a112-5fe761cf4448 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.536477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 431/874] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:41.544346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c000-195a-46a2-8cdf-3e4ff446cef2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.544881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c000-195a-46a2-8cdf-3e4ff446cef2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.545175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72c000-195a-46a2-8cdf-3e4ff446cef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.564505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6a72c000-195a-46a2-8cdf-3e4ff446cef2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:41.566214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6a72c000-195a-46a2-8cdf-3e4ff446cef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:41.635882 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 444/875] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:41 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:41.660401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962003fc-9ca3-4b50-a112-5fe761cf4448 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.701618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.768628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962003fc-9ca3-4b50-a112-5fe761cf4448 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.808380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5422b8-e77b-4d8d-96c6-f2dfdd6fe0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.809165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5422b8-e77b-4d8d-96c6-f2dfdd6fe0bf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.809450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5422b8-e77b-4d8d-96c6-f2dfdd6fe0bf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.809725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5422b8-e77b-4d8d-96c6-f2dfdd6fe0bf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.812165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5422b8-e77b-4d8d-96c6-f2dfdd6fe0bf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.812165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5422b8-e77b-4d8d-96c6-f2dfdd6fe0bf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-1e5422b8-e77b-4d8d-96c6-f2dfdd6fe0bf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:41.821916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:41.822886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:41.823709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 432/876] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:41.831072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c000-195a-46a2-8cdf-3e4ff446cef2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.914921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.935093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72c000-195a-46a2-8cdf-3e4ff446cef2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.975117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d61a54-db09-4991-a937-b82d95a28813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.975743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61a54-db09-4991-a937-b82d95a28813 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.976022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61a54-db09-4991-a937-b82d95a28813 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.976416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d61a54-db09-4991-a937-b82d95a28813 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.977099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d61a54-db09-4991-a937-b82d95a28813 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:41.977403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d61a54-db09-4991-a937-b82d95a28813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.978765 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d61a54-db09-4991-a937-b82d95a28813 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.983826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 445/877] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:41.990046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5422b8-e77b-4d8d-96c6-f2dfdd6fe0bf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.095465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.098771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5422b8-e77b-4d8d-96c6-f2dfdd6fe0bf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.123162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c97022-f5e5-447c-bb81-9a0d047e9ad5 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.123457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c97022-f5e5-447c-bb81-9a0d047e9ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.123710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c97022-f5e5-447c-bb81-9a0d047e9ad5 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.126255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 446/878] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:42.130208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29372205-64d6-45bc-9606-69606dd9df9f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.130506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29372205-64d6-45bc-9606-69606dd9df9f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.130770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29372205-64d6-45bc-9606-69606dd9df9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.134428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf872-5254-46a8-b7db-f8a6edc3a1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.135046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf872-5254-46a8-b7db-f8a6edc3a1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.135327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf872-5254-46a8-b7db-f8a6edc3a1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.135596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2cf872-5254-46a8-b7db-f8a6edc3a1d5 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.136297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf872-5254-46a8-b7db-f8a6edc3a1d5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:42.136599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf872-5254-46a8-b7db-f8a6edc3a1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.138124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2cf872-5254-46a8-b7db-f8a6edc3a1d5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.144725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 433/879] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:42.150046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-29372205-64d6-45bc-9606-69606dd9df9f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:42.151461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-29372205-64d6-45bc-9606-69606dd9df9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:42.153162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf872-5254-46a8-b7db-f8a6edc3a1d5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.240274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 447/880] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:27:42.257462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29372205-64d6-45bc-9606-69606dd9df9f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.289253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2cf872-5254-46a8-b7db-f8a6edc3a1d5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.333321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8e13c-9900-4fe3-972f-85efceee78fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.334851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e13c-9900-4fe3-972f-85efceee78fa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.335338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e13c-9900-4fe3-972f-85efceee78fa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.335984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e13c-9900-4fe3-972f-85efceee78fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.337083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8e13c-9900-4fe3-972f-85efceee78fa None admin] RBAC: Adding query filter params (interface=public, service_id=2dc24fbb12c04e2b9477708585c0abbe, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:42.337650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8e13c-9900-4fe3-972f-85efceee78fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.339988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8e13c-9900-4fe3-972f-85efceee78fa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.348735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 434/881] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/endpoints?service_id=2dc24fbb12c04e2b9477708585c0abbe&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:42.355584 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8e13c-9900-4fe3-972f-85efceee78fa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.367954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.392519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.400671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29372205-64d6-45bc-9606-69606dd9df9f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.438059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15830450-7a41-4995-ac92-79cfb4035f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.438858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15830450-7a41-4995-ac92-79cfb4035f42 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.439143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15830450-7a41-4995-ac92-79cfb4035f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.439412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15830450-7a41-4995-ac92-79cfb4035f42 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.440070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15830450-7a41-4995-ac92-79cfb4035f42 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.441492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15830450-7a41-4995-ac92-79cfb4035f42 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-15830450-7a41-4995-ac92-79cfb4035f42 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:42.450425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:42.451370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:42.453058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 448/882] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:42.453826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5382d0-6d44-4ec6-8760-cc41312e70b4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.453826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5382d0-6d44-4ec6-8760-cc41312e70b4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.453826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5382d0-6d44-4ec6-8760-cc41312e70b4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.454755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 449/883] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:42.459305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5382d0-6d44-4ec6-8760-cc41312e70b4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.476810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8e13c-9900-4fe3-972f-85efceee78fa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.510714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3d973-588c-4a25-8c0e-8114cb565240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.511262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d973-588c-4a25-8c0e-8114cb565240 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.511548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d973-588c-4a25-8c0e-8114cb565240 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.511825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3d973-588c-4a25-8c0e-8114cb565240 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.512505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d973-588c-4a25-8c0e-8114cb565240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.513865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3d973-588c-4a25-8c0e-8114cb565240 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.519911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 435/884] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/services => generated 1011 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:27:42.521093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9d2d8-2daa-4332-bac0-788ffeec2462 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.521382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9d2d8-2daa-4332-bac0-788ffeec2462 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.521662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9d2d8-2daa-4332-bac0-788ffeec2462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.546381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6de9d2d8-2daa-4332-bac0-788ffeec2462 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:42.548535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6de9d2d8-2daa-4332-bac0-788ffeec2462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:42.583034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5382d0-6d44-4ec6-8760-cc41312e70b4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.634393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309ed6-3b12-43ef-b9b9-c2f32bb3cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.635105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309ed6-3b12-43ef-b9b9-c2f32bb3cf12 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.635389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309ed6-3b12-43ef-b9b9-c2f32bb3cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.635665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf309ed6-3b12-43ef-b9b9-c2f32bb3cf12 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.636431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309ed6-3b12-43ef-b9b9-c2f32bb3cf12 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:42.636798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309ed6-3b12-43ef-b9b9-c2f32bb3cf12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.638230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf309ed6-3b12-43ef-b9b9-c2f32bb3cf12 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.651420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 450/885] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:42.651617 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 436/886] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:42 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:42.651732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309ed6-3b12-43ef-b9b9-c2f32bb3cf12 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.670084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.673058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9d2d8-2daa-4332-bac0-788ffeec2462 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.709078 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.779862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf309ed6-3b12-43ef-b9b9-c2f32bb3cf12 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.827300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9d2d8-2daa-4332-bac0-788ffeec2462 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.833578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc2472-cf30-4bfb-9f67-08f3214504dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.834459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2472-cf30-4bfb-9f67-08f3214504dc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.834975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2472-cf30-4bfb-9f67-08f3214504dc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.835450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc2472-cf30-4bfb-9f67-08f3214504dc None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.836353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2472-cf30-4bfb-9f67-08f3214504dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:42.836852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2472-cf30-4bfb-9f67-08f3214504dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.839012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc2472-cf30-4bfb-9f67-08f3214504dc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.852385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 451/887] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:42.875925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc2829-316b-491f-80d2-bb59e4cfeda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.876595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc2829-316b-491f-80d2-bb59e4cfeda7 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.876875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc2829-316b-491f-80d2-bb59e4cfeda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.877666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc2829-316b-491f-80d2-bb59e4cfeda7 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.878405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc2829-316b-491f-80d2-bb59e4cfeda7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.879805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc2829-316b-491f-80d2-bb59e4cfeda7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.901688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 437/888] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:27:42 2022] POST /identity/v3/services => generated 269 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:27:43.597234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e649d-91e8-41ae-984e-aa61e34a14c4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.597736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e649d-91e8-41ae-984e-aa61e34a14c4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.597811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e649d-91e8-41ae-984e-aa61e34a14c4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.599339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 452/889] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:43.604401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e615a9d-a598-49a2-8672-658bf7b293ea None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.604779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e615a9d-a598-49a2-8672-658bf7b293ea None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.604954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e615a9d-a598-49a2-8672-658bf7b293ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.623655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9e615a9d-a598-49a2-8672-658bf7b293ea None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:43.624869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9e615a9d-a598-49a2-8672-658bf7b293ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:43.701538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 438/890] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:43.726062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e649d-91e8-41ae-984e-aa61e34a14c4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.813133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:43.832155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e649d-91e8-41ae-984e-aa61e34a14c4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.869547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef85d-8407-40e6-92ec-9cdcd24359f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.870112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef85d-8407-40e6-92ec-9cdcd24359f0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.870393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef85d-8407-40e6-92ec-9cdcd24359f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.870668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ef85d-8407-40e6-92ec-9cdcd24359f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.881510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ef85d-8407-40e6-92ec-9cdcd24359f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3d0ef85d-8407-40e6-92ec-9cdcd24359f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:43.886478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:43.887346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:43.888341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 453/891] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:43.897106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e615a9d-a598-49a2-8672-658bf7b293ea None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.915686 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.043174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e615a9d-a598-49a2-8672-658bf7b293ea None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.088973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25850c7d-fcfe-4495-8200-f07e4455a9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.089964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25850c7d-fcfe-4495-8200-f07e4455a9cb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.090437 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25850c7d-fcfe-4495-8200-f07e4455a9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.090899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25850c7d-fcfe-4495-8200-f07e4455a9cb None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.091841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25850c7d-fcfe-4495-8200-f07e4455a9cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:44.092380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25850c7d-fcfe-4495-8200-f07e4455a9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.093923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25850c7d-fcfe-4495-8200-f07e4455a9cb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.103966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 439/892] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:44.109171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef85d-8407-40e6-92ec-9cdcd24359f0 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.212323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ef85d-8407-40e6-92ec-9cdcd24359f0 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.244649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.254832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1981b4-952d-422f-9c23-c704e6edaeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.255710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1981b4-952d-422f-9c23-c704e6edaeae None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.256222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1981b4-952d-422f-9c23-c704e6edaeae None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.256710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1981b4-952d-422f-9c23-c704e6edaeae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.268213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1981b4-952d-422f-9c23-c704e6edaeae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.269918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1981b4-952d-422f-9c23-c704e6edaeae None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-be1981b4-952d-422f-9c23-c704e6edaeae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:44.285450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:44.286345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:44.287209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:44.287209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:44.287209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:44.287209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:44.289465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 454/893] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:44.297270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25850c7d-fcfe-4495-8200-f07e4455a9cb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.370555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.412545 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25850c7d-fcfe-4495-8200-f07e4455a9cb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.448606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51c1e2-921e-4e7d-a6df-4098846f919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.449230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51c1e2-921e-4e7d-a6df-4098846f919c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.449509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51c1e2-921e-4e7d-a6df-4098846f919c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.449784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51c1e2-921e-4e7d-a6df-4098846f919c None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.450476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51c1e2-921e-4e7d-a6df-4098846f919c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:44.450779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51c1e2-921e-4e7d-a6df-4098846f919c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.452431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51c1e2-921e-4e7d-a6df-4098846f919c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.466425 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 440/894] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:44.472158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1981b4-952d-422f-9c23-c704e6edaeae None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.582182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1981b4-952d-422f-9c23-c704e6edaeae None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.617421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef192c-2f01-4ad6-b8ee-330e618ca226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.618883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef192c-2f01-4ad6-b8ee-330e618ca226 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.619366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef192c-2f01-4ad6-b8ee-330e618ca226 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.619838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef192c-2f01-4ad6-b8ee-330e618ca226 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.628566 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef192c-2f01-4ad6-b8ee-330e618ca226 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.630332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef192c-2f01-4ad6-b8ee-330e618ca226 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-22ef192c-2f01-4ad6-b8ee-330e618ca226 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:44.642546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:44.644063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:44.645034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:44.647603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 455/895] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:44.652946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51c1e2-921e-4e7d-a6df-4098846f919c None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.766160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51c1e2-921e-4e7d-a6df-4098846f919c None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.796977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.804432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dd5db-21c2-4dcf-8673-af1c949fd7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.807657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dd5db-21c2-4dcf-8673-af1c949fd7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.807657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dd5db-21c2-4dcf-8673-af1c949fd7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.807881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6a495-cca3-4af0-967b-0287b7f2c02c None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.807881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6a495-cca3-4af0-967b-0287b7f2c02c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.807881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6a495-cca3-4af0-967b-0287b7f2c02c None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.809062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dd5db-21c2-4dcf-8673-af1c949fd7a3 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.809227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 456/896] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:44.809935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dd5db-21c2-4dcf-8673-af1c949fd7a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:44.810254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dd5db-21c2-4dcf-8673-af1c949fd7a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.811688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53dd5db-21c2-4dcf-8673-af1c949fd7a3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.818794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835c8c8-a21a-4562-8777-86864acfb001 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.819314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835c8c8-a21a-4562-8777-86864acfb001 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.819812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835c8c8-a21a-4562-8777-86864acfb001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.833458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 441/897] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:44.838909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dd5db-21c2-4dcf-8673-af1c949fd7a3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.843375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5835c8c8-a21a-4562-8777-86864acfb001 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:44.844824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5835c8c8-a21a-4562-8777-86864acfb001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:44.893755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.948180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 457/898] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:27:44.955103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dd5db-21c2-4dcf-8673-af1c949fd7a3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.965044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835c8c8-a21a-4562-8777-86864acfb001 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.999377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e27a2e-c530-45ac-ba9a-af4a59e9b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.000724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e27a2e-c530-45ac-ba9a-af4a59e9b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.001490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e27a2e-c530-45ac-ba9a-af4a59e9b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.002970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e27a2e-c530-45ac-ba9a-af4a59e9b7d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.063978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.075152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835c8c8-a21a-4562-8777-86864acfb001 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.077631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e27a2e-c530-45ac-ba9a-af4a59e9b7d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.079076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e27a2e-c530-45ac-ba9a-af4a59e9b7d5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.109513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04dae4-1564-4091-a8c0-733d2f510e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.110148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04dae4-1564-4091-a8c0-733d2f510e4b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.110431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04dae4-1564-4091-a8c0-733d2f510e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.110703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04dae4-1564-4091-a8c0-733d2f510e4b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.111328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04dae4-1564-4091-a8c0-733d2f510e4b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.113271 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04dae4-1564-4091-a8c0-733d2f510e4b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4b04dae4-1564-4091-a8c0-733d2f510e4b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:45.121975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:45.123103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:45.123915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 458/899] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:45.124773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae80a4d-a35b-4177-ba56-e40bb1ff915b None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.124773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae80a4d-a35b-4177-ba56-e40bb1ff915b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.124773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae80a4d-a35b-4177-ba56-e40bb1ff915b None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.125978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 459/900] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:45.127022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61ca6-3613-4bb2-877b-d293e38e1de5 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.127311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61ca6-3613-4bb2-877b-d293e38e1de5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.127581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf61ca6-3613-4bb2-877b-d293e38e1de5 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.132398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 460/901] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:45.133111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf61ca6-3613-4bb2-877b-d293e38e1de5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.167917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.187519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 442/902] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:27:45.187519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2fccd-29bb-497c-a720-cd2dbaf9649e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.187519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2fccd-29bb-497c-a720-cd2dbaf9649e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.187519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2fccd-29bb-497c-a720-cd2dbaf9649e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.201384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-14d2fccd-29bb-497c-a720-cd2dbaf9649e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:45.202582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-14d2fccd-29bb-497c-a720-cd2dbaf9649e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:45.238356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf61ca6-3613-4bb2-877b-d293e38e1de5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.267271 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 443/903] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:45.268531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca0911-4b9e-42d5-864c-5c24bd65cde2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.268816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca0911-4b9e-42d5-864c-5c24bd65cde2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.269088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca0911-4b9e-42d5-864c-5c24bd65cde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.271001 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135ad45-44a0-4824-9b65-33fbd9ee2550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.271617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135ad45-44a0-4824-9b65-33fbd9ee2550 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.271909 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135ad45-44a0-4824-9b65-33fbd9ee2550 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.272211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135ad45-44a0-4824-9b65-33fbd9ee2550 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.272892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135ad45-44a0-4824-9b65-33fbd9ee2550 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:45.273200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135ad45-44a0-4824-9b65-33fbd9ee2550 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.274563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135ad45-44a0-4824-9b65-33fbd9ee2550 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.284170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 461/904] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:45.284853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135ad45-44a0-4824-9b65-33fbd9ee2550 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.291745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5fca0911-4b9e-42d5-864c-5c24bd65cde2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:45.292982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5fca0911-4b9e-42d5-864c-5c24bd65cde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:45.307267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.359154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 444/905] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:45.359907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca0911-4b9e-42d5-864c-5c24bd65cde2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.388368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.392070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135ad45-44a0-4824-9b65-33fbd9ee2550 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.435267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889743d-0fc8-4f45-83bc-cce918df2e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.436262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889743d-0fc8-4f45-83bc-cce918df2e79 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.436698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889743d-0fc8-4f45-83bc-cce918df2e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.437106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889743d-0fc8-4f45-83bc-cce918df2e79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.452410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889743d-0fc8-4f45-83bc-cce918df2e79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.453907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889743d-0fc8-4f45-83bc-cce918df2e79 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.463219 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca0911-4b9e-42d5-864c-5c24bd65cde2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-d889743d-0fc8-4f45-83bc-cce918df2e79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:45.468039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:45.469086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:45.470637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:45.470637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:45.470637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:45.470637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:45.470637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 462/906] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:45.470637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889743d-0fc8-4f45-83bc-cce918df2e79 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.499990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d261b1-1873-441f-93d5-b8dde5d9a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.500645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d261b1-1873-441f-93d5-b8dde5d9a85f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.500926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d261b1-1873-441f-93d5-b8dde5d9a85f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.501247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d261b1-1873-441f-93d5-b8dde5d9a85f None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.502009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d261b1-1873-441f-93d5-b8dde5d9a85f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:45.502313 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d261b1-1873-441f-93d5-b8dde5d9a85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.503662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d261b1-1873-441f-93d5-b8dde5d9a85f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.508401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 445/907] 10.222.0.57 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:45.509164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d261b1-1873-441f-93d5-b8dde5d9a85f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.524921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.569977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889743d-0fc8-4f45-83bc-cce918df2e79 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.603053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7306dee-9ff9-43d8-9107-9478001d2ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.603664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7306dee-9ff9-43d8-9107-9478001d2ff1 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.603957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7306dee-9ff9-43d8-9107-9478001d2ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.604256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7306dee-9ff9-43d8-9107-9478001d2ff1 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.604943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7306dee-9ff9-43d8-9107-9478001d2ff1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.606312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7306dee-9ff9-43d8-9107-9478001d2ff1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.610104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d261b1-1873-441f-93d5-b8dde5d9a85f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.620776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 463/908] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:27:45 2022] POST /identity/v3/services => generated 241 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:45.621576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7306dee-9ff9-43d8-9107-9478001d2ff1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.635236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.670212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5163-6107-42d0-9d3f-35e6908ee734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.670966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5163-6107-42d0-9d3f-35e6908ee734 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.671156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5163-6107-42d0-9d3f-35e6908ee734 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.671458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a5163-6107-42d0-9d3f-35e6908ee734 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.672107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a5163-6107-42d0-9d3f-35e6908ee734 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.673550 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a5163-6107-42d0-9d3f-35e6908ee734 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-690a5163-6107-42d0-9d3f-35e6908ee734 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:45.683414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:45.684665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:45.685623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 446/909] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:45.686474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5163-6107-42d0-9d3f-35e6908ee734 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.751599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7306dee-9ff9-43d8-9107-9478001d2ff1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.771178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.790971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee13de-37f1-4484-ae6d-d5b9619a06b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.791868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee13de-37f1-4484-ae6d-d5b9619a06b1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.792233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee13de-37f1-4484-ae6d-d5b9619a06b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.792946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee13de-37f1-4484-ae6d-d5b9619a06b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.794197 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee13de-37f1-4484-ae6d-d5b9619a06b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:45.794197 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee13de-37f1-4484-ae6d-d5b9619a06b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.795784 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee13de-37f1-4484-ae6d-d5b9619a06b1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.810192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a5163-6107-42d0-9d3f-35e6908ee734 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.811189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 464/910] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:45.812172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee13de-37f1-4484-ae6d-d5b9619a06b1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.848987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f3bd0-fb1f-4ef4-9cbb-2c900d3ee4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.849604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f3bd0-fb1f-4ef4-9cbb-2c900d3ee4b7 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.849884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f3bd0-fb1f-4ef4-9cbb-2c900d3ee4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.850155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f3bd0-fb1f-4ef4-9cbb-2c900d3ee4b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.850862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f3bd0-fb1f-4ef4-9cbb-2c900d3ee4b7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.852359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f3bd0-fb1f-4ef4-9cbb-2c900d3ee4b7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.880246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 447/911] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:27:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:45.880246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f3bd0-fb1f-4ef4-9cbb-2c900d3ee4b7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.891320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.928856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee13de-37f1-4484-ae6d-d5b9619a06b1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.980326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1073b8-e252-40eb-b543-48878d5578aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.980959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1073b8-e252-40eb-b543-48878d5578aa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.981237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1073b8-e252-40eb-b543-48878d5578aa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.981510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1073b8-e252-40eb-b543-48878d5578aa None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.982256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1073b8-e252-40eb-b543-48878d5578aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:45.982773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1073b8-e252-40eb-b543-48878d5578aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.984212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1073b8-e252-40eb-b543-48878d5578aa None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.990450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 465/912] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:45.995885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1073b8-e252-40eb-b543-48878d5578aa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:46.016973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f3bd0-fb1f-4ef4-9cbb-2c900d3ee4b7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:46.050083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:46.059871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd7600-955b-41d5-a85c-8775df45d128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:46.060725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd7600-955b-41d5-a85c-8775df45d128 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.061191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd7600-955b-41d5-a85c-8775df45d128 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.061618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd7600-955b-41d5-a85c-8775df45d128 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:46.071115 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd7600-955b-41d5-a85c-8775df45d128 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:46.072828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd7600-955b-41d5-a85c-8775df45d128 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-94dd7600-955b-41d5-a85c-8775df45d128 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:46.086874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:46.087809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:46.088944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:46.088944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:46.088944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:46.088944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:46.088944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:46.088944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:46.088944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:46.088944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:46.090526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 448/913] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:46.096179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd7600-955b-41d5-a85c-8775df45d128 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:46.128545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1073b8-e252-40eb-b543-48878d5578aa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:46.164721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:46.170114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74c185-3329-4498-980b-0ef0168096c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:46.171332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74c185-3329-4498-980b-0ef0168096c5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.171765 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74c185-3329-4498-980b-0ef0168096c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.172237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74c185-3329-4498-980b-0ef0168096c5 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:46.173067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74c185-3329-4498-980b-0ef0168096c5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:46.173516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74c185-3329-4498-980b-0ef0168096c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:46.175241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74c185-3329-4498-980b-0ef0168096c5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:46.181013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 466/914] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:46.192168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74c185-3329-4498-980b-0ef0168096c5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:46.214714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd7600-955b-41d5-a85c-8775df45d128 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:46.249115 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643e35b-5026-42f4-969b-3d29d14d77db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:46.249906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643e35b-5026-42f4-969b-3d29d14d77db None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.250290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643e35b-5026-42f4-969b-3d29d14d77db None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.250666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643e35b-5026-42f4-969b-3d29d14d77db None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:46.251601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643e35b-5026-42f4-969b-3d29d14d77db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:46.252612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643e35b-5026-42f4-969b-3d29d14d77db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:46.254146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643e35b-5026-42f4-969b-3d29d14d77db None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:46.267356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 449/915] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:46.273908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643e35b-5026-42f4-969b-3d29d14d77db None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:46.310409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74c185-3329-4498-980b-0ef0168096c5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:46.337367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:46.354763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226dec7-6c47-4d6c-9054-c621c85bb978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:46.355706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226dec7-6c47-4d6c-9054-c621c85bb978 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.356288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226dec7-6c47-4d6c-9054-c621c85bb978 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.356738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226dec7-6c47-4d6c-9054-c621c85bb978 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:46.357517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226dec7-6c47-4d6c-9054-c621c85bb978 None admin] RBAC: Adding query filter params (interface=public, service_id=731e96b9b9d34b3481ffcfadac7ea30f, region_id=RegionOne) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:46.357831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226dec7-6c47-4d6c-9054-c621c85bb978 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:46.359921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226dec7-6c47-4d6c-9054-c621c85bb978 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:46.370259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 467/916] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 21:27:46 2022] GET /identity/v3/endpoints?service_id=731e96b9b9d34b3481ffcfadac7ea30f&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:46.375279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226dec7-6c47-4d6c-9054-c621c85bb978 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:46.400479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643e35b-5026-42f4-969b-3d29d14d77db None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:46.437281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660115a-bbf6-481a-bd1f-77e42e6769ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:46.437848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660115a-bbf6-481a-bd1f-77e42e6769ee None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.438135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660115a-bbf6-481a-bd1f-77e42e6769ee None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.438404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660115a-bbf6-481a-bd1f-77e42e6769ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:46.439195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660115a-bbf6-481a-bd1f-77e42e6769ee None admin] RBAC: Adding query filter params (role.id=aba8cdd000504e74bea65f7b87138d77, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=31a94e98e1b2499f8417dd10d00e780e) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:46.440057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660115a-bbf6-481a-bd1f-77e42e6769ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:46.441588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660115a-bbf6-481a-bd1f-77e42e6769ee None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:46.442321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:46.449085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 450/917] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:46 2022] GET /identity/v3/role_assignments?user.id=31a94e98e1b2499f8417dd10d00e780e&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=aba8cdd000504e74bea65f7b87138d77 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:46.495384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226dec7-6c47-4d6c-9054-c621c85bb978 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:46.535242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f4a23-e332-421b-b429-08e5e6adda7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:46.536217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4a23-e332-421b-b429-08e5e6adda7c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.536674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4a23-e332-421b-b429-08e5e6adda7c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.537089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f4a23-e332-421b-b429-08e5e6adda7c None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:46.537946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f4a23-e332-421b-b429-08e5e6adda7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:46.539497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f4a23-e332-421b-b429-08e5e6adda7c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:46.552313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 468/918] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 21:27:46 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:27:47.676710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652528ef-adb3-4bc5-a6a7-d75fd3a6ce66 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.677728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652528ef-adb3-4bc5-a6a7-d75fd3a6ce66 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.678209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652528ef-adb3-4bc5-a6a7-d75fd3a6ce66 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.680028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 451/919] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:47.685445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64933b-c361-4d08-a643-7175f5fa055b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.686258 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64933b-c361-4d08-a643-7175f5fa055b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.686733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64933b-c361-4d08-a643-7175f5fa055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.705302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6c64933b-c361-4d08-a643-7175f5fa055b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:47.706812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6c64933b-c361-4d08-a643-7175f5fa055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:47.788280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 469/920] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:47.810928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652528ef-adb3-4bc5-a6a7-d75fd3a6ce66 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.915930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652528ef-adb3-4bc5-a6a7-d75fd3a6ce66 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:47.944867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:47.953253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbde3cb-0a6c-42c1-954c-43176eaea08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:47.953903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbde3cb-0a6c-42c1-954c-43176eaea08d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.954576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbde3cb-0a6c-42c1-954c-43176eaea08d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.955533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbde3cb-0a6c-42c1-954c-43176eaea08d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.956375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbde3cb-0a6c-42c1-954c-43176eaea08d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:47.957753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbde3cb-0a6c-42c1-954c-43176eaea08d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-5fbde3cb-0a6c-42c1-954c-43176eaea08d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:47.967287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:47.968329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:47.969409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 452/921] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:47.977169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64933b-c361-4d08-a643-7175f5fa055b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.033703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.047569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ebae0-fda1-4eac-ba6f-9ce382dfd9c6 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.047857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ebae0-fda1-4eac-ba6f-9ce382dfd9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.048064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ebae0-fda1-4eac-ba6f-9ce382dfd9c6 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.049639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 453/922] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:48.055101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64c94-2c44-4b46-914a-7a8f756a1479 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.055640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64c94-2c44-4b46-914a-7a8f756a1479 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.056124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac64c94-2c44-4b46-914a-7a8f756a1479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.076382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fac64c94-2c44-4b46-914a-7a8f756a1479 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:48.077995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fac64c94-2c44-4b46-914a-7a8f756a1479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:48.084727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64933b-c361-4d08-a643-7175f5fa055b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.119929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2c216-34b9-4dfe-9889-281da05fa5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.120639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2c216-34b9-4dfe-9889-281da05fa5f9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.120918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2c216-34b9-4dfe-9889-281da05fa5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.121189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2c216-34b9-4dfe-9889-281da05fa5f9 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.121877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2c216-34b9-4dfe-9889-281da05fa5f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:48.122196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2c216-34b9-4dfe-9889-281da05fa5f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.123544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2c216-34b9-4dfe-9889-281da05fa5f9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.133730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 470/923] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:48.135022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2c216-34b9-4dfe-9889-281da05fa5f9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.160297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 454/924] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:27:48.179249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac64c94-2c44-4b46-914a-7a8f756a1479 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.237478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2c216-34b9-4dfe-9889-281da05fa5f9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.255083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.273668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac8845-ae24-4859-84bd-54d1a48a166b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.274376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac8845-ae24-4859-84bd-54d1a48a166b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.274717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac8845-ae24-4859-84bd-54d1a48a166b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.275066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac8845-ae24-4859-84bd-54d1a48a166b None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.275860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac8845-ae24-4859-84bd-54d1a48a166b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:48.276257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac8845-ae24-4859-84bd-54d1a48a166b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.277696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac8845-ae24-4859-84bd-54d1a48a166b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.283143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 471/925] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:48.289014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac8845-ae24-4859-84bd-54d1a48a166b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.290572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac64c94-2c44-4b46-914a-7a8f756a1479 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.298518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.328654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.329774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.330806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.331411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.332332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.334129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.337155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING keystone.server.flask.common [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 21:27:48.362982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.sql.core [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 21:27:48.362982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 21:27:48.362982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [parameters: {'id': 'f096784ed1ef40f987dbc3e541b5f437', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 21:27:48.362982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80435) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f096784ed1ef40f987dbc3e541b5f437.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f096784ed1ef40f987dbc3e541b5f437. Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:27:48.386382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 02 21:27:48.387233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application yield resource Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise self.value Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application session.commit() Aug 02 21:27:48.388185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.flush() Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application compat.raise_( Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 21:27:48.389045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 21:27:48.389898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:27:48.390661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [parameters: {'id': 'f096784ed1ef40f987dbc3e541b5f437', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:48.391513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:48.392398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f096784ed1ef40f987dbc3e541b5f437. Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:48.393958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 455/926] 10.222.0.57 () {60 vars in 1140 bytes} [Tue Aug 2 21:27:48 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:48.399409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac8845-ae24-4859-84bd-54d1a48a166b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.400760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.450458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1505-c763-47cf-89fb-03a99a8de195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.451459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1505-c763-47cf-89fb-03a99a8de195 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.451930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1505-c763-47cf-89fb-03a99a8de195 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.452438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a1505-c763-47cf-89fb-03a99a8de195 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.453366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1505-c763-47cf-89fb-03a99a8de195 None admin] RBAC: Adding query filter params (interface=public, service_id=4fa5483667da4c939fd3d6ec21dc6b55, region_id=RegionOne) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:48.453877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1505-c763-47cf-89fb-03a99a8de195 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.455977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a1505-c763-47cf-89fb-03a99a8de195 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.462435 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 472/927] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/endpoints?service_id=4fa5483667da4c939fd3d6ec21dc6b55&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:48.467987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1505-c763-47cf-89fb-03a99a8de195 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.526916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.534168 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0697c16-d309-4c79-a8a3-61def6328f2f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.571026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228a513-74ff-4485-9c4b-b1777280a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.571956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228a513-74ff-4485-9c4b-b1777280a373 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.572458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228a513-74ff-4485-9c4b-b1777280a373 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.572900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228a513-74ff-4485-9c4b-b1777280a373 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.580055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228a513-74ff-4485-9c4b-b1777280a373 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.581972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228a513-74ff-4485-9c4b-b1777280a373 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.585496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a1505-c763-47cf-89fb-03a99a8de195 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d228a513-74ff-4485-9c4b-b1777280a373 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:48.594327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:48.595231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:48.596164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:48.596164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:48.596164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:48.596164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:48.596164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:48.596164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:48.596164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:48.596164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:48.602224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 456/928] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:48.602224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf948f8-1017-4bc6-b716-eab409aedbc9 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.602224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf948f8-1017-4bc6-b716-eab409aedbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.602224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf948f8-1017-4bc6-b716-eab409aedbc9 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.603678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 457/929] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:48.605582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf948f8-1017-4bc6-b716-eab409aedbc9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.622950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7769f80f-7f3a-449f-9951-8963888def77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.623569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769f80f-7f3a-449f-9951-8963888def77 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.623854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769f80f-7f3a-449f-9951-8963888def77 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.624117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7769f80f-7f3a-449f-9951-8963888def77 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.624796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769f80f-7f3a-449f-9951-8963888def77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.626263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7769f80f-7f3a-449f-9951-8963888def77 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.632680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.636208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 473/930] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:27:48.636208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4075f37-efdb-421f-80af-1d81a581fa42 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.636208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4075f37-efdb-421f-80af-1d81a581fa42 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.636208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4075f37-efdb-421f-80af-1d81a581fa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.661557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f4075f37-efdb-421f-80af-1d81a581fa42 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:48.662791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f4075f37-efdb-421f-80af-1d81a581fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:48.727827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf948f8-1017-4bc6-b716-eab409aedbc9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.739245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 474/931] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:48.740888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f15ad-8b6a-4160-a7c9-243e82da4505 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.741175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f15ad-8b6a-4160-a7c9-243e82da4505 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.741448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f15ad-8b6a-4160-a7c9-243e82da4505 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.742848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 475/932] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:48.748318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c44b-7e7b-4daf-95b6-b994ca141551 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.748611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c44b-7e7b-4daf-95b6-b994ca141551 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.748861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c44b-7e7b-4daf-95b6-b994ca141551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.773676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9960c44b-7e7b-4daf-95b6-b994ca141551 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:48.774915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9960c44b-7e7b-4daf-95b6-b994ca141551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:48.777196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2a360-0e49-46c1-8606-dcfc22f243e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.777764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2a360-0e49-46c1-8606-dcfc22f243e0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.778050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2a360-0e49-46c1-8606-dcfc22f243e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.778379 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2a360-0e49-46c1-8606-dcfc22f243e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.779419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2a360-0e49-46c1-8606-dcfc22f243e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:48.779776 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2a360-0e49-46c1-8606-dcfc22f243e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.781320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2a360-0e49-46c1-8606-dcfc22f243e0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.805152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 458/933] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:48.805845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2a360-0e49-46c1-8606-dcfc22f243e0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.815108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.869447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 476/934] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:48.891214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960c44b-7e7b-4daf-95b6-b994ca141551 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.911982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.934378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2a360-0e49-46c1-8606-dcfc22f243e0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.989179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d82226-3dfd-42e6-8fa5-99da0ae166a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.990815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d82226-3dfd-42e6-8fa5-99da0ae166a5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.990815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d82226-3dfd-42e6-8fa5-99da0ae166a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.990815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d82226-3dfd-42e6-8fa5-99da0ae166a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.003284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d82226-3dfd-42e6-8fa5-99da0ae166a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-81d82226-3dfd-42e6-8fa5-99da0ae166a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:49.008636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:49.009531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:27:49.010330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:49.012571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 459/935] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:49.019137 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d82226-3dfd-42e6-8fa5-99da0ae166a5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.026408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960c44b-7e7b-4daf-95b6-b994ca141551 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.073165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c5387-fc08-4304-b79b-8f74b379bd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.073851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c5387-fc08-4304-b79b-8f74b379bd59 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.074128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c5387-fc08-4304-b79b-8f74b379bd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.074397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c5387-fc08-4304-b79b-8f74b379bd59 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.075180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c5387-fc08-4304-b79b-8f74b379bd59 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.076714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c5387-fc08-4304-b79b-8f74b379bd59 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8d7c5387-fc08-4304-b79b-8f74b379bd59 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:49.086177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:49.087127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:49.087963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 477/936] 10.222.0.57 () {56 vars in 1132 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:49.094009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c5387-fc08-4304-b79b-8f74b379bd59 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.128518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.148322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d82226-3dfd-42e6-8fa5-99da0ae166a5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.192165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8274b-1d77-4740-9f8c-53651f42d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.192903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8274b-1d77-4740-9f8c-53651f42d42e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.193252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8274b-1d77-4740-9f8c-53651f42d42e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.194025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8274b-1d77-4740-9f8c-53651f42d42e None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.194820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8274b-1d77-4740-9f8c-53651f42d42e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:49.195352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8274b-1d77-4740-9f8c-53651f42d42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.197082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8274b-1d77-4740-9f8c-53651f42d42e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.206109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c5387-fc08-4304-b79b-8f74b379bd59 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.212223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 460/937] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:49.214748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8274b-1d77-4740-9f8c-53651f42d42e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.218921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.257477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3db1f9-85ab-4e71-bfb0-86c2d972abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.259067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3db1f9-85ab-4e71-bfb0-86c2d972abdc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.259425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3db1f9-85ab-4e71-bfb0-86c2d972abdc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.259774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3db1f9-85ab-4e71-bfb0-86c2d972abdc None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.260568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3db1f9-85ab-4e71-bfb0-86c2d972abdc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:49.260946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3db1f9-85ab-4e71-bfb0-86c2d972abdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.262393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3db1f9-85ab-4e71-bfb0-86c2d972abdc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.269717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 478/938] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:49.274952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3db1f9-85ab-4e71-bfb0-86c2d972abdc None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.330521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8274b-1d77-4740-9f8c-53651f42d42e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.366911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827692e7-f272-49ad-824b-165b8b6624e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.367791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827692e7-f272-49ad-824b-165b8b6624e9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.368266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827692e7-f272-49ad-824b-165b8b6624e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.368680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827692e7-f272-49ad-824b-165b8b6624e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.380451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827692e7-f272-49ad-824b-165b8b6624e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.382229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827692e7-f272-49ad-824b-165b8b6624e9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-827692e7-f272-49ad-824b-165b8b6624e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:49.398327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:49.399228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:49.400156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:49.400156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:49.400156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:49.400156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:49.400376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.411006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3db1f9-85ab-4e71-bfb0-86c2d972abdc None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.412778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 461/939] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:49.421334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827692e7-f272-49ad-824b-165b8b6624e9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.454353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3691-a6b4-47d4-a240-fbd5542debbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.455621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3691-a6b4-47d4-a240-fbd5542debbf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.456015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3691-a6b4-47d4-a240-fbd5542debbf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.456340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c3691-a6b4-47d4-a240-fbd5542debbf None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.457028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c3691-a6b4-47d4-a240-fbd5542debbf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:49.457335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c3691-a6b4-47d4-a240-fbd5542debbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.459404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c3691-a6b4-47d4-a240-fbd5542debbf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.466279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 479/940] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:49.472716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3691-a6b4-47d4-a240-fbd5542debbf None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.491174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.541117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827692e7-f272-49ad-824b-165b8b6624e9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.573173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c3691-a6b4-47d4-a240-fbd5542debbf None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.578305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423a5c5-cf19-473a-8630-c81afa624612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.579124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423a5c5-cf19-473a-8630-c81afa624612 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.579557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423a5c5-cf19-473a-8630-c81afa624612 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.580587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c423a5c5-cf19-473a-8630-c81afa624612 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.581529 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423a5c5-cf19-473a-8630-c81afa624612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:49.582049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423a5c5-cf19-473a-8630-c81afa624612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.583750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c423a5c5-cf19-473a-8630-c81afa624612 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.599734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 462/941] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:49.605109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423a5c5-cf19-473a-8630-c81afa624612 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.608749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b802c7-00e8-4735-a1de-8c400570223f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.609989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b802c7-00e8-4735-a1de-8c400570223f None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.609989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b802c7-00e8-4735-a1de-8c400570223f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.609989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b802c7-00e8-4735-a1de-8c400570223f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.610584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b802c7-00e8-4735-a1de-8c400570223f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.611982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b802c7-00e8-4735-a1de-8c400570223f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.644719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 480/942] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:27:49 2022] POST /identity/v3/endpoints => generated 347 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:49.734326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c423a5c5-cf19-473a-8630-c81afa624612 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.753793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.783193 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aac7c-8cc2-4cee-84f7-663a038766bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.783899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aac7c-8cc2-4cee-84f7-663a038766bb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.784335 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aac7c-8cc2-4cee-84f7-663a038766bb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.784527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8aac7c-8cc2-4cee-84f7-663a038766bb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.793023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aac7c-8cc2-4cee-84f7-663a038766bb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.794497 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8aac7c-8cc2-4cee-84f7-663a038766bb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-cf8aac7c-8cc2-4cee-84f7-663a038766bb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:49.820203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:49.821268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:49.822274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 463/943] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:49.827148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b802c7-00e8-4735-a1de-8c400570223f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.848603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.941832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b802c7-00e8-4735-a1de-8c400570223f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.976370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b6e68-a59d-47bd-8ca5-551c6c4b4d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.976992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6e68-a59d-47bd-8ca5-551c6c4b4d07 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.977270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6e68-a59d-47bd-8ca5-551c6c4b4d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.977542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b6e68-a59d-47bd-8ca5-551c6c4b4d07 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.978339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b6e68-a59d-47bd-8ca5-551c6c4b4d07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:49.978646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b6e68-a59d-47bd-8ca5-551c6c4b4d07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.980071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b6e68-a59d-47bd-8ca5-551c6c4b4d07 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.003186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 481/944] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:50.004548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aac7c-8cc2-4cee-84f7-663a038766bb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.113536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8aac7c-8cc2-4cee-84f7-663a038766bb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.149718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16a9f2-b9ee-4075-a5ed-a00fc4c66a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.150721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16a9f2-b9ee-4075-a5ed-a00fc4c66a66 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.151234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16a9f2-b9ee-4075-a5ed-a00fc4c66a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.151731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb16a9f2-b9ee-4075-a5ed-a00fc4c66a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.163488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16a9f2-b9ee-4075-a5ed-a00fc4c66a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.165253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb16a9f2-b9ee-4075-a5ed-a00fc4c66a66 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-bb16a9f2-b9ee-4075-a5ed-a00fc4c66a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:50.180759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:50.181656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:50.182524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:50.182524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:50.182524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:50.182524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:50.184730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 464/945] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:50.196261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b6e68-a59d-47bd-8ca5-551c6c4b4d07 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.280331 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:50.307036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b6e68-a59d-47bd-8ca5-551c6c4b4d07 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.343607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae447b7-ba48-4dc0-b130-e8630e54d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.344279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae447b7-ba48-4dc0-b130-e8630e54d4ca None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.344570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae447b7-ba48-4dc0-b130-e8630e54d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.344845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae447b7-ba48-4dc0-b130-e8630e54d4ca None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.346071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae447b7-ba48-4dc0-b130-e8630e54d4ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:50.346381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae447b7-ba48-4dc0-b130-e8630e54d4ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.347751 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae447b7-ba48-4dc0-b130-e8630e54d4ca None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.359757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 482/946] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:50.365962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16a9f2-b9ee-4075-a5ed-a00fc4c66a66 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.407643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:50.494378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb16a9f2-b9ee-4075-a5ed-a00fc4c66a66 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.529923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde5c2-2c9a-4d95-b5da-7ce21413026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.530574 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde5c2-2c9a-4d95-b5da-7ce21413026a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.530854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde5c2-2c9a-4d95-b5da-7ce21413026a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.531124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde5c2-2c9a-4d95-b5da-7ce21413026a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.538772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebde5c2-2c9a-4d95-b5da-7ce21413026a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.540233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebde5c2-2c9a-4d95-b5da-7ce21413026a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-8ebde5c2-2c9a-4d95-b5da-7ce21413026a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:50.552398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:50.553287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:50.554599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:50.554599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:50.554599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:50.554599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:50.554599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:50.554599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:50.554599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:50.554599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:50.554599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 465/947] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:50.561431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae447b7-ba48-4dc0-b130-e8630e54d4ca None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.671457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae447b7-ba48-4dc0-b130-e8630e54d4ca None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.706655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f47d4-6b26-47f9-b0e7-579522f0b9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.707277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f47d4-6b26-47f9-b0e7-579522f0b9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.707560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f47d4-6b26-47f9-b0e7-579522f0b9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.707838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f47d4-6b26-47f9-b0e7-579522f0b9b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.708621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f47d4-6b26-47f9-b0e7-579522f0b9b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:50.708934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f47d4-6b26-47f9-b0e7-579522f0b9b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.710364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f47d4-6b26-47f9-b0e7-579522f0b9b5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.711930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:50.723904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 483/948] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:50.730512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde5c2-2c9a-4d95-b5da-7ce21413026a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.769709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240252b3-375a-43b6-8619-73a59afeb890 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.770028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240252b3-375a-43b6-8619-73a59afeb890 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.770266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240252b3-375a-43b6-8619-73a59afeb890 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.771881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 484/949] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:50.777776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ce78d-9b6b-494a-a70c-43d27a7c199c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.778065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ce78d-9b6b-494a-a70c-43d27a7c199c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.778342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ce78d-9b6b-494a-a70c-43d27a7c199c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.802479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f47ce78d-9b6b-494a-a70c-43d27a7c199c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:50.803592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f47ce78d-9b6b-494a-a70c-43d27a7c199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:50.829590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:50.849810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde5c2-2c9a-4d95-b5da-7ce21413026a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.891089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 485/950] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:50.896849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76449d9d-c2c9-403e-9192-e188551b84c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.897769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76449d9d-c2c9-403e-9192-e188551b84c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.898279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76449d9d-c2c9-403e-9192-e188551b84c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.898758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76449d9d-c2c9-403e-9192-e188551b84c3 None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/31a94e98e1b2499f8417dd10d00e780e/roles/aba8cdd000504e74bea65f7b87138d77` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.901202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76449d9d-c2c9-403e-9192-e188551b84c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=31a94e98e1b2499f8417dd10d00e780e, role_id=aba8cdd000504e74bea65f7b87138d77)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.902897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76449d9d-c2c9-403e-9192-e188551b84c3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.915110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ce78d-9b6b-494a-a70c-43d27a7c199c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.928431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 466/951] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:50 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/31a94e98e1b2499f8417dd10d00e780e/roles/aba8cdd000504e74bea65f7b87138d77 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:51.018871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e2ee5-7fdd-406a-bf54-9c502f7a2608 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.019255 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e2ee5-7fdd-406a-bf54-9c502f7a2608 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.019448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e2ee5-7fdd-406a-bf54-9c502f7a2608 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.021104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 467/952] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:51.026408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbe7bb-8376-4b64-a84e-47ca4062ae45 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.026712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbe7bb-8376-4b64-a84e-47ca4062ae45 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.026958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbe7bb-8376-4b64-a84e-47ca4062ae45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.042853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ce78d-9b6b-494a-a70c-43d27a7c199c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.047635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-20cbe7bb-8376-4b64-a84e-47ca4062ae45 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:51.049306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-20cbe7bb-8376-4b64-a84e-47ca4062ae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:51.073235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.081104 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14ace5-5560-4171-95e6-1b6db5fd30c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.081760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14ace5-5560-4171-95e6-1b6db5fd30c2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.082042 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14ace5-5560-4171-95e6-1b6db5fd30c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.082317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d14ace5-5560-4171-95e6-1b6db5fd30c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.082953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14ace5-5560-4171-95e6-1b6db5fd30c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.084378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d14ace5-5560-4171-95e6-1b6db5fd30c2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-6d14ace5-5560-4171-95e6-1b6db5fd30c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:51.094513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:51.096406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:51.097544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 486/953] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:51.102786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14ace5-5560-4171-95e6-1b6db5fd30c2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.146256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 468/954] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:27:51.171296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbe7bb-8376-4b64-a84e-47ca4062ae45 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.218344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d14ace5-5560-4171-95e6-1b6db5fd30c2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.255382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d123-3457-4ee3-9c00-636f73096f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.256382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d123-3457-4ee3-9c00-636f73096f1f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.256863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d123-3457-4ee3-9c00-636f73096f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.257357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0d123-3457-4ee3-9c00-636f73096f1f None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.258230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d123-3457-4ee3-9c00-636f73096f1f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:51.258733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d123-3457-4ee3-9c00-636f73096f1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.260381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0d123-3457-4ee3-9c00-636f73096f1f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.266231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 487/955] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:51.267008 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.272544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d123-3457-4ee3-9c00-636f73096f1f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.299390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbe7bb-8376-4b64-a84e-47ca4062ae45 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.340922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.344961 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.346570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.346859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.347129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.347939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.349767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.370311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.sql.core [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 21:27:51.370311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 21:27:51.370311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [parameters: {'user_id': 'a82e3d4ac76248cf90558fb13d546123', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 21:27:51.370311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80435) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Aug 02 21:27:51.380941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:27:51.381947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application yield resource Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise self.value Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application session.commit() Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 21:27:51.382893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.session.flush() Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application compat.raise_( Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 21:27:51.383803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:27:51.385841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application result.read() Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:27:51.387848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a82e3d4ac76248cf90558fb13d546123', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:51.390010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 02 21:27:51.391930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 02 21:27:51.397583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 02 21:27:51.397583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 02 21:27:51.397583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 21:27:51.397583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 21:27:51.397583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 21:27:51.397583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:51.402187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0d123-3457-4ee3-9c00-636f73096f1f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.402442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 469/956] 10.222.0.57 () {60 vars in 1131 bytes} [Tue Aug 2 21:27:51 2022] POST /identity/v3/users => generated 160 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:51.404478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.437018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772bd0-4d93-4a9a-b8b1-09d5eabf1a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.437646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772bd0-4d93-4a9a-b8b1-09d5eabf1a99 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.437923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772bd0-4d93-4a9a-b8b1-09d5eabf1a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.438190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772bd0-4d93-4a9a-b8b1-09d5eabf1a99 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.438871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41772bd0-4d93-4a9a-b8b1-09d5eabf1a99 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:51.439725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41772bd0-4d93-4a9a-b8b1-09d5eabf1a99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.441083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41772bd0-4d93-4a9a-b8b1-09d5eabf1a99 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.446532 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 488/957] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:51.453170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772bd0-4d93-4a9a-b8b1-09d5eabf1a99 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.532808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33924e41-b5e2-4928-86c3-12fe015aea6d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.569510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41772bd0-4d93-4a9a-b8b1-09d5eabf1a99 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.578241 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e79e6-64f4-4a9e-a325-430f5857d879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.578899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e79e6-64f4-4a9e-a325-430f5857d879 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.579177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e79e6-64f4-4a9e-a325-430f5857d879 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.579451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e79e6-64f4-4a9e-a325-430f5857d879 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.583285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.590120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e79e6-64f4-4a9e-a325-430f5857d879 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.591563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.593148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e79e6-64f4-4a9e-a325-430f5857d879 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-241e79e6-64f4-4a9e-a325-430f5857d879 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:51.613535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:51.614749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:27:51.615929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:51.618517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 470/958] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:51.622292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f57c6-e192-40fc-b204-92060dbde8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.622292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f57c6-e192-40fc-b204-92060dbde8de None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.622292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f57c6-e192-40fc-b204-92060dbde8de None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.622292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f57c6-e192-40fc-b204-92060dbde8de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.622774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f57c6-e192-40fc-b204-92060dbde8de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.624150 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e79e6-64f4-4a9e-a325-430f5857d879 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.625406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f57c6-e192-40fc-b204-92060dbde8de None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.656312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 489/959] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:27:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:51.746104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e79e6-64f4-4a9e-a325-430f5857d879 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.795613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7e45-011b-4a8f-ac87-d6532a81a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.796643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7e45-011b-4a8f-ac87-d6532a81a26a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.797128 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7e45-011b-4a8f-ac87-d6532a81a26a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.797619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7e45-011b-4a8f-ac87-d6532a81a26a None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.799191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7e45-011b-4a8f-ac87-d6532a81a26a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:51.799725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7e45-011b-4a8f-ac87-d6532a81a26a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.801421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7e45-011b-4a8f-ac87-d6532a81a26a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.841866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 471/960] 10.222.0.57 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:51.930819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb310a-bcd4-43c7-9b12-c94ea59bf13f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.931498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb310a-bcd4-43c7-9b12-c94ea59bf13f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.931498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb310a-bcd4-43c7-9b12-c94ea59bf13f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.934980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 490/961] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:51.940339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950abbe-36b6-4f4a-bbf4-8e0c2534f361 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.940654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950abbe-36b6-4f4a-bbf4-8e0c2534f361 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.940896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950abbe-36b6-4f4a-bbf4-8e0c2534f361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.962184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f950abbe-36b6-4f4a-bbf4-8e0c2534f361 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:51.964985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f950abbe-36b6-4f4a-bbf4-8e0c2534f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:52.021018 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:52.042995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 472/962] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:52.065133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb310a-bcd4-43c7-9b12-c94ea59bf13f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.177153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb310a-bcd4-43c7-9b12-c94ea59bf13f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.211207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a706f-dbab-4b99-a6b9-f6bcb4f2fb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.211853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a706f-dbab-4b99-a6b9-f6bcb4f2fb27 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.212150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a706f-dbab-4b99-a6b9-f6bcb4f2fb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.212441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a706f-dbab-4b99-a6b9-f6bcb4f2fb27 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.213073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a706f-dbab-4b99-a6b9-f6bcb4f2fb27 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.214442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a706f-dbab-4b99-a6b9-f6bcb4f2fb27 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-9c9a706f-dbab-4b99-a6b9-f6bcb4f2fb27 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:52.223279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:52.224534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:52.225389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 491/963] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:52.230613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950abbe-36b6-4f4a-bbf4-8e0c2534f361 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.337093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950abbe-36b6-4f4a-bbf4-8e0c2534f361 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.371736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45516f3c-017c-435c-b153-f0247243351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.372378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516f3c-017c-435c-b153-f0247243351e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.372664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516f3c-017c-435c-b153-f0247243351e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.372934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45516f3c-017c-435c-b153-f0247243351e None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.373607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45516f3c-017c-435c-b153-f0247243351e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:52.373911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45516f3c-017c-435c-b153-f0247243351e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.375265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45516f3c-017c-435c-b153-f0247243351e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.380750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 473/964] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:52.386407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a706f-dbab-4b99-a6b9-f6bcb4f2fb27 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.421400 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:52.490260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a706f-dbab-4b99-a6b9-f6bcb4f2fb27 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.524284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed792a6-8503-4660-9ad7-f18014822fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.524903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed792a6-8503-4660-9ad7-f18014822fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.525185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed792a6-8503-4660-9ad7-f18014822fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.525459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed792a6-8503-4660-9ad7-f18014822fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.526145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed792a6-8503-4660-9ad7-f18014822fb7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:52.526449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed792a6-8503-4660-9ad7-f18014822fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.527806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed792a6-8503-4660-9ad7-f18014822fb7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.532724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 492/965] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:53.042171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201b64-28c2-40d4-a183-d7ad5fea8a80 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:53.042714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201b64-28c2-40d4-a183-d7ad5fea8a80 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:53.042714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44201b64-28c2-40d4-a183-d7ad5fea8a80 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:53.044116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 474/966] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:53.049243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c38d-814b-4d84-879f-b215b39fea91 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:53.049633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c38d-814b-4d84-879f-b215b39fea91 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:53.049792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315c38d-814b-4d84-879f-b215b39fea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:53.067950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2315c38d-814b-4d84-879f-b215b39fea91 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:53.069508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2315c38d-814b-4d84-879f-b215b39fea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:53.137867 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 493/967] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:53.161879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201b64-28c2-40d4-a183-d7ad5fea8a80 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:53.209706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:53.265634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44201b64-28c2-40d4-a183-d7ad5fea8a80 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:53.300824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a334f8c-692e-469b-845b-00438a50ec56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:53.301459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a334f8c-692e-469b-845b-00438a50ec56 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:53.301740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a334f8c-692e-469b-845b-00438a50ec56 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:53.302013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a334f8c-692e-469b-845b-00438a50ec56 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:53.312118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a334f8c-692e-469b-845b-00438a50ec56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9a334f8c-692e-469b-845b-00438a50ec56 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:53.317059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:53.318024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:53.323752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 475/968] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 21:27:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:53.326064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c38d-814b-4d84-879f-b215b39fea91 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:53.356457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:53.426916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315c38d-814b-4d84-879f-b215b39fea91 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:53.461465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d63662-6a53-4710-8780-24c282709b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:53.462083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d63662-6a53-4710-8780-24c282709b3f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:53.462366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d63662-6a53-4710-8780-24c282709b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:53.462638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d63662-6a53-4710-8780-24c282709b3f None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:53.463352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d63662-6a53-4710-8780-24c282709b3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:53.463658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d63662-6a53-4710-8780-24c282709b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:53.465047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d63662-6a53-4710-8780-24c282709b3f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:53.473740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 494/969] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 21:27:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:53.479211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a334f8c-692e-469b-845b-00438a50ec56 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:53.579522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a334f8c-692e-469b-845b-00438a50ec56 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:53.582452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:53.615779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96c3f0-63da-4a20-82e9-d561ebff3563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:53.616455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c3f0-63da-4a20-82e9-d561ebff3563 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:53.616746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c3f0-63da-4a20-82e9-d561ebff3563 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:53.617018 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96c3f0-63da-4a20-82e9-d561ebff3563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:53.628773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96c3f0-63da-4a20-82e9-d561ebff3563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:53.630371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96c3f0-63da-4a20-82e9-d561ebff3563 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ea96c3f0-63da-4a20-82e9-d561ebff3563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:53.646659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:53.647585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:53.648848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:53.648848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:53.648848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:53.648848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:53.652461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 476/970] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:53.653571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d63662-6a53-4710-8780-24c282709b3f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:53.736659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5f618-451c-47f8-8001-57e2339923dd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:53.736987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5f618-451c-47f8-8001-57e2339923dd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:53.737207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5f618-451c-47f8-8001-57e2339923dd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:53.738740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 477/971] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:53.743177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778782f-b354-46a9-b5ab-94bbd86e108a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:53.743454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778782f-b354-46a9-b5ab-94bbd86e108a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:53.743734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778782f-b354-46a9-b5ab-94bbd86e108a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:53.746148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:53.756811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d63662-6a53-4710-8780-24c282709b3f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:53.763312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a778782f-b354-46a9-b5ab-94bbd86e108a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:53.764522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a778782f-b354-46a9-b5ab-94bbd86e108a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:53.796880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f717c-feff-431a-b865-e40f6e102634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:53.797501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f717c-feff-431a-b865-e40f6e102634 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:53.797780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f717c-feff-431a-b865-e40f6e102634 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:53.798050 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f717c-feff-431a-b865-e40f6e102634 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:53.799524 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f717c-feff-431a-b865-e40f6e102634 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:53.799845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f717c-feff-431a-b865-e40f6e102634 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:53.801714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f717c-feff-431a-b865-e40f6e102634 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:53.815743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 495/972] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:53.820981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f717c-feff-431a-b865-e40f6e102634 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:53.844075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 478/973] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:27:53.866823 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778782f-b354-46a9-b5ab-94bbd86e108a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:53.922242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f717c-feff-431a-b865-e40f6e102634 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:53.957320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb36a1f-0b9a-429b-a6cf-c5e70238e54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:53.957965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb36a1f-0b9a-429b-a6cf-c5e70238e54c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:53.958247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb36a1f-0b9a-429b-a6cf-c5e70238e54c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:53.958523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb36a1f-0b9a-429b-a6cf-c5e70238e54c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:53.965204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:53.965602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb36a1f-0b9a-429b-a6cf-c5e70238e54c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:53.967068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb36a1f-0b9a-429b-a6cf-c5e70238e54c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ccb36a1f-0b9a-429b-a6cf-c5e70238e54c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:27:53.979363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:53.980344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:53.986586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 496/974] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:27:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:53.987213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb36a1f-0b9a-429b-a6cf-c5e70238e54c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:53.989674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778782f-b354-46a9-b5ab-94bbd86e108a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.001307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:54.026653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3764c46-5b81-454f-a703-a163fda6d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.027291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3764c46-5b81-454f-a703-a163fda6d87f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.027570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3764c46-5b81-454f-a703-a163fda6d87f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.027841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3764c46-5b81-454f-a703-a163fda6d87f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.028487 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3764c46-5b81-454f-a703-a163fda6d87f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.030202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3764c46-5b81-454f-a703-a163fda6d87f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-f3764c46-5b81-454f-a703-a163fda6d87f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:54.039254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:54.040242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:54.041091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 479/975] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:54.046177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3764c46-5b81-454f-a703-a163fda6d87f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:54.093241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb36a1f-0b9a-429b-a6cf-c5e70238e54c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.130555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba3846-c849-4663-8375-e42c1c8958bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.131145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba3846-c849-4663-8375-e42c1c8958bf None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.131385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba3846-c849-4663-8375-e42c1c8958bf None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.131661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba3846-c849-4663-8375-e42c1c8958bf None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.132493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba3846-c849-4663-8375-e42c1c8958bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:54.132803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba3846-c849-4663-8375-e42c1c8958bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.134233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feba3846-c849-4663-8375-e42c1c8958bf None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.149846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3764c46-5b81-454f-a703-a163fda6d87f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.156979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 497/976] 10.222.0.57 () {56 vars in 1149 bytes} [Tue Aug 2 21:27:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:54.158287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba3846-c849-4663-8375-e42c1c8958bf None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:54.185926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7b659-179a-45ae-aed9-f417254a75f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.186712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7b659-179a-45ae-aed9-f417254a75f2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.187004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7b659-179a-45ae-aed9-f417254a75f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.187284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7b659-179a-45ae-aed9-f417254a75f2 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.188026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7b659-179a-45ae-aed9-f417254a75f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:54.188367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7b659-179a-45ae-aed9-f417254a75f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.189788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7b659-179a-45ae-aed9-f417254a75f2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.194745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 480/977] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:54.200127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7b659-179a-45ae-aed9-f417254a75f2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:54.217223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:54.231735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:54.270735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba3846-c849-4663-8375-e42c1c8958bf None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.312793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59182eee-31c9-48d8-b3a0-a198527d4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.313407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59182eee-31c9-48d8-b3a0-a198527d4544 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.313685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59182eee-31c9-48d8-b3a0-a198527d4544 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.313982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59182eee-31c9-48d8-b3a0-a198527d4544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.316319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7b659-179a-45ae-aed9-f417254a75f2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.356036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43959f6b-8a86-4e7c-aa6a-15300f651061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.357463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43959f6b-8a86-4e7c-aa6a-15300f651061 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.357934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43959f6b-8a86-4e7c-aa6a-15300f651061 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.358387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43959f6b-8a86-4e7c-aa6a-15300f651061 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.359424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43959f6b-8a86-4e7c-aa6a-15300f651061 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:54.360266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43959f6b-8a86-4e7c-aa6a-15300f651061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.362779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43959f6b-8a86-4e7c-aa6a-15300f651061 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.369718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 481/978] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:54.375103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43959f6b-8a86-4e7c-aa6a-15300f651061 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:54.383324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59182eee-31c9-48d8-b3a0-a198527d4544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.384738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59182eee-31c9-48d8-b3a0-a198527d4544 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.455066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:54.459571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:54.484420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43959f6b-8a86-4e7c-aa6a-15300f651061 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.491514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 498/979] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:27:54.496830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59182eee-31c9-48d8-b3a0-a198527d4544 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:54.522005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633ca7d-5e95-487c-b78d-7927c75aa5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.522722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ca7d-5e95-487c-b78d-7927c75aa5cd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.523111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ca7d-5e95-487c-b78d-7927c75aa5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.523384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633ca7d-5e95-487c-b78d-7927c75aa5cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.524164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633ca7d-5e95-487c-b78d-7927c75aa5cd None admin] RBAC: Adding query filter params (interface=admin, service_id=4fa5483667da4c939fd3d6ec21dc6b55, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:54.524461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633ca7d-5e95-487c-b78d-7927c75aa5cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.526033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3633ca7d-5e95-487c-b78d-7927c75aa5cd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.536539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 482/980] 10.222.0.57 () {56 vars in 1249 bytes} [Tue Aug 2 21:27:54 2022] GET /identity/v3/endpoints?service_id=4fa5483667da4c939fd3d6ec21dc6b55&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:54.536539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d7251-602c-467c-a128-583ef4ef1908 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.536774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d7251-602c-467c-a128-583ef4ef1908 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.536862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d7251-602c-467c-a128-583ef4ef1908 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.538081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 483/981] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:54.538769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d7251-602c-467c-a128-583ef4ef1908 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:54.594615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59182eee-31c9-48d8-b3a0-a198527d4544 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.628948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775d954-d38d-45fd-aae5-730f51d3baad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.629695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d954-d38d-45fd-aae5-730f51d3baad None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.629975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d954-d38d-45fd-aae5-730f51d3baad None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.630251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775d954-d38d-45fd-aae5-730f51d3baad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.644107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d7251-602c-467c-a128-583ef4ef1908 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.644591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d954-d38d-45fd-aae5-730f51d3baad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.646047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775d954-d38d-45fd-aae5-730f51d3baad None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-2775d954-d38d-45fd-aae5-730f51d3baad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:54.661573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:54.662507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:54.663371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:54.663371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:54.663371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:54.663371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:54.663371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 499/982] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:54.663923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21e6a-426c-4cf2-9909-a7a88811b228 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.664163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21e6a-426c-4cf2-9909-a7a88811b228 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.664443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21e6a-426c-4cf2-9909-a7a88811b228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.681294 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626cf9b-6fb2-40f3-b3f0-670584fc5e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.681504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b4d21e6a-426c-4cf2-9909-a7a88811b228 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:54.681914 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626cf9b-6fb2-40f3-b3f0-670584fc5e22 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.682199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626cf9b-6fb2-40f3-b3f0-670584fc5e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.682474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626cf9b-6fb2-40f3-b3f0-670584fc5e22 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.682571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b4d21e6a-426c-4cf2-9909-a7a88811b228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:54.683128 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626cf9b-6fb2-40f3-b3f0-670584fc5e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.684527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626cf9b-6fb2-40f3-b3f0-670584fc5e22 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.690435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 484/983] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 21:27:54 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:27:54.691211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626cf9b-6fb2-40f3-b3f0-670584fc5e22 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:54.700555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:54.708530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:54.772255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 500/984] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:54.792653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21e6a-426c-4cf2-9909-a7a88811b228 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:54.812955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626cf9b-6fb2-40f3-b3f0-670584fc5e22 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.855663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108afd5-fa36-41da-ab69-75c79b10cbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.855663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108afd5-fa36-41da-ab69-75c79b10cbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.855972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108afd5-fa36-41da-ab69-75c79b10cbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.856214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4108afd5-fa36-41da-ab69-75c79b10cbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.856918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108afd5-fa36-41da-ab69-75c79b10cbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:54.857227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108afd5-fa36-41da-ab69-75c79b10cbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.858588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4108afd5-fa36-41da-ab69-75c79b10cbd7 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.871375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 485/985] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:54.877600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108afd5-fa36-41da-ab69-75c79b10cbd7 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:54.914074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21e6a-426c-4cf2-9909-a7a88811b228 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:54.956976 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:54.960811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c6a18-3232-426a-bf47-59004bc12b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:54.962410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6a18-3232-426a-bf47-59004bc12b67 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:54.963784 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6a18-3232-426a-bf47-59004bc12b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:54.964236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6a18-3232-426a-bf47-59004bc12b67 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:54.965083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c6a18-3232-426a-bf47-59004bc12b67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:54.966644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c6a18-3232-426a-bf47-59004bc12b67 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:54.994295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 501/986] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:27:54 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:27:54.998979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4108afd5-fa36-41da-ab69-75c79b10cbd7 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:55.045231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eff1d0-6e9d-45f2-a773-8fa18456b4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:55.045888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eff1d0-6e9d-45f2-a773-8fa18456b4fe None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:55.046164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eff1d0-6e9d-45f2-a773-8fa18456b4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:55.046431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eff1d0-6e9d-45f2-a773-8fa18456b4fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:55.054166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eff1d0-6e9d-45f2-a773-8fa18456b4fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:55.055827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eff1d0-6e9d-45f2-a773-8fa18456b4fe None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-28eff1d0-6e9d-45f2-a773-8fa18456b4fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:27:55.069907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:55.071122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:55.072165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:27:55.072165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:27:55.072165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:27:55.072165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:27:55.072165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:27:55.072165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:27:55.072165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:27:55.072165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:55.072165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 486/987] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:55.077112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c6a18-3232-426a-bf47-59004bc12b67 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:55.093489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:55.189551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c6a18-3232-426a-bf47-59004bc12b67 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:55.223823 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1d54b-3130-45bf-8319-7de70ebcacef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:55.224475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1d54b-3130-45bf-8319-7de70ebcacef None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:55.224759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1d54b-3130-45bf-8319-7de70ebcacef None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:55.225033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1d54b-3130-45bf-8319-7de70ebcacef None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:55.225782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1d54b-3130-45bf-8319-7de70ebcacef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:55.226091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1d54b-3130-45bf-8319-7de70ebcacef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:55.227520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1d54b-3130-45bf-8319-7de70ebcacef None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:55.240170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 502/988] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:55.246260 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eff1d0-6e9d-45f2-a773-8fa18456b4fe None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:55.349430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eff1d0-6e9d-45f2-a773-8fa18456b4fe None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:55.372501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:55.385884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88226483-5606-4b21-871a-1d1b3bde9808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:55.386559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88226483-5606-4b21-871a-1d1b3bde9808 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:55.386843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88226483-5606-4b21-871a-1d1b3bde9808 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:55.387111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88226483-5606-4b21-871a-1d1b3bde9808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:55.387921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88226483-5606-4b21-871a-1d1b3bde9808 None admin] RBAC: Adding query filter params (role.id=aba8cdd000504e74bea65f7b87138d77, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=31a94e98e1b2499f8417dd10d00e780e) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:55.388542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88226483-5606-4b21-871a-1d1b3bde9808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:55.389698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88226483-5606-4b21-871a-1d1b3bde9808 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:55.402663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 487/989] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:55 2022] GET /identity/v3/role_assignments?user.id=31a94e98e1b2499f8417dd10d00e780e&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=aba8cdd000504e74bea65f7b87138d77 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:56.704328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90746-2ebe-465a-a05c-cea0f76c753e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.705448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90746-2ebe-465a-a05c-cea0f76c753e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.705448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc90746-2ebe-465a-a05c-cea0f76c753e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.706906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 503/990] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:56.711917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c3c63-6034-4528-a63e-23be268bd29b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.712353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c3c63-6034-4528-a63e-23be268bd29b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.712515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c3c63-6034-4528-a63e-23be268bd29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.730304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0b8c3c63-6034-4528-a63e-23be268bd29b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:56.731463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0b8c3c63-6034-4528-a63e-23be268bd29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:56.808294 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 488/991] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:56 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:56.825769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc90746-2ebe-465a-a05c-cea0f76c753e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:56.899404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:56.932658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc90746-2ebe-465a-a05c-cea0f76c753e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:56.967081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca3d92-942e-44da-828c-311e6bda89e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:56.967639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca3d92-942e-44da-828c-311e6bda89e2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.967916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca3d92-942e-44da-828c-311e6bda89e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.968210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca3d92-942e-44da-828c-311e6bda89e2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.968830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca3d92-942e-44da-828c-311e6bda89e2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:56.970215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca3d92-942e-44da-828c-311e6bda89e2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-fdca3d92-942e-44da-828c-311e6bda89e2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:56.978908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:56.979914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:27:56.980781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:56.982238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 504/992] 10.222.0.57 () {56 vars in 1126 bytes} [Tue Aug 2 21:27:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:56.986697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c3c63-6034-4528-a63e-23be268bd29b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.027251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73473-0edd-4ffe-a877-d00bd190c5c4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.027568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73473-0edd-4ffe-a877-d00bd190c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.027806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b73473-0edd-4ffe-a877-d00bd190c5c4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.029641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 505/993] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:57.035182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2205e43-278e-4c6b-8220-001f79a5e630 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.035182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2205e43-278e-4c6b-8220-001f79a5e630 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.036478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2205e43-278e-4c6b-8220-001f79a5e630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.055165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f2205e43-278e-4c6b-8220-001f79a5e630 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:57.056090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f2205e43-278e-4c6b-8220-001f79a5e630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:57.114334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8c3c63-6034-4528-a63e-23be268bd29b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.133511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.140516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 506/994] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:57 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:57.151637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2205e43-278e-4c6b-8220-001f79a5e630 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.153045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e95383-6848-4daa-bf4f-c4cadb9acda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.154248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95383-6848-4daa-bf4f-c4cadb9acda5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.154779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95383-6848-4daa-bf4f-c4cadb9acda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.155285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e95383-6848-4daa-bf4f-c4cadb9acda5 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.156200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e95383-6848-4daa-bf4f-c4cadb9acda5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:57.156725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e95383-6848-4daa-bf4f-c4cadb9acda5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.158820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e95383-6848-4daa-bf4f-c4cadb9acda5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.164979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 489/995] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:57.170476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e95383-6848-4daa-bf4f-c4cadb9acda5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.236449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.277062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2205e43-278e-4c6b-8220-001f79a5e630 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.298841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e95383-6848-4daa-bf4f-c4cadb9acda5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.313878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2eddd-17a0-4eca-b095-e34ad97c3cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.314560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2eddd-17a0-4eca-b095-e34ad97c3cbc None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.314843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2eddd-17a0-4eca-b095-e34ad97c3cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.315119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2eddd-17a0-4eca-b095-e34ad97c3cbc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.315749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2eddd-17a0-4eca-b095-e34ad97c3cbc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.317166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2eddd-17a0-4eca-b095-e34ad97c3cbc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-63f2eddd-17a0-4eca-b095-e34ad97c3cbc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:57.326280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:57.327310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:27:57.328170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:27:57.332761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 507/996] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:57.333614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2eddd-17a0-4eca-b095-e34ad97c3cbc None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.343844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4d2d2-df06-4470-8517-ed3dab3ae70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.344911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4d2d2-df06-4470-8517-ed3dab3ae70e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.345738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4d2d2-df06-4470-8517-ed3dab3ae70e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.346019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4d2d2-df06-4470-8517-ed3dab3ae70e None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.346700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4d2d2-df06-4470-8517-ed3dab3ae70e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:57.347449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4d2d2-df06-4470-8517-ed3dab3ae70e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.348861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4d2d2-df06-4470-8517-ed3dab3ae70e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.354071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 490/997] 10.222.0.57 () {56 vars in 1122 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:57.359504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4d2d2-df06-4470-8517-ed3dab3ae70e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.423864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.460356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2eddd-17a0-4eca-b095-e34ad97c3cbc None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.488279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4d2d2-df06-4470-8517-ed3dab3ae70e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.494506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.502411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aee9a-4507-41d1-abc1-1da4189e8d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.503040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aee9a-4507-41d1-abc1-1da4189e8d59 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.503321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aee9a-4507-41d1-abc1-1da4189e8d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.503593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aee9a-4507-41d1-abc1-1da4189e8d59 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.504303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aee9a-4507-41d1-abc1-1da4189e8d59 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:57.504607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aee9a-4507-41d1-abc1-1da4189e8d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.505978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aee9a-4507-41d1-abc1-1da4189e8d59 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.510885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 508/998] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:57.512024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7cf51-6466-4c1f-b3e8-998eee15da4e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.512351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7cf51-6466-4c1f-b3e8-998eee15da4e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.512652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7cf51-6466-4c1f-b3e8-998eee15da4e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.513838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 509/999] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:57.516624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7cf51-6466-4c1f-b3e8-998eee15da4e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.527492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd996e-71c7-4cb5-975d-ad7a017270db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.528105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd996e-71c7-4cb5-975d-ad7a017270db None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.528413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd996e-71c7-4cb5-975d-ad7a017270db None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.528934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd996e-71c7-4cb5-975d-ad7a017270db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.529636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd996e-71c7-4cb5-975d-ad7a017270db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.530975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd996e-71c7-4cb5-975d-ad7a017270db None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.549869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 491/1000] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:27:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:27:57.551926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3519f-30d6-4df4-a7e1-df085e360ff3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.552323 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3519f-30d6-4df4-a7e1-df085e360ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.552654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3519f-30d6-4df4-a7e1-df085e360ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.584508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6fe3519f-30d6-4df4-a7e1-df085e360ff3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:57.585716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6fe3519f-30d6-4df4-a7e1-df085e360ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:57.641333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7cf51-6466-4c1f-b3e8-998eee15da4e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.661019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 492/1001] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:57 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:57.679905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949e1a-e035-470b-a78f-6691c0d771c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.680626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949e1a-e035-470b-a78f-6691c0d771c3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.680907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949e1a-e035-470b-a78f-6691c0d771c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.681178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47949e1a-e035-470b-a78f-6691c0d771c3 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.681875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47949e1a-e035-470b-a78f-6691c0d771c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:57.682179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47949e1a-e035-470b-a78f-6691c0d771c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.682849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3519f-30d6-4df4-a7e1-df085e360ff3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.683640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47949e1a-e035-470b-a78f-6691c0d771c3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.694798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 510/1002] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:57.695969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949e1a-e035-470b-a78f-6691c0d771c3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.725139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.759636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.807244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3519f-30d6-4df4-a7e1-df085e360ff3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.811689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47949e1a-e035-470b-a78f-6691c0d771c3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.842778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4221ad5-9022-4511-b75e-473ae51d0d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.843422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4221ad5-9022-4511-b75e-473ae51d0d10 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.843701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4221ad5-9022-4511-b75e-473ae51d0d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.843969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4221ad5-9022-4511-b75e-473ae51d0d10 None admin] PATH_INFO: `/v3/services/image` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.844624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4221ad5-9022-4511-b75e-473ae51d0d10 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.846647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4221ad5-9022-4511-b75e-473ae51d0d10 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.849441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0986d1-9283-4af8-84b8-cba0ea096e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.850258 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0986d1-9283-4af8-84b8-cba0ea096e0a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.850697 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0986d1-9283-4af8-84b8-cba0ea096e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.851124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0986d1-9283-4af8-84b8-cba0ea096e0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.852040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0986d1-9283-4af8-84b8-cba0ea096e0a None admin] RBAC: Adding query filter params (interface=public, service_id=0c916af19ea04f979ee7f06ed3ace1f3, region_id=RegionOne) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:57.852571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0986d1-9283-4af8-84b8-cba0ea096e0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.854257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0986d1-9283-4af8-84b8-cba0ea096e0a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-d4221ad5-9022-4511-b75e-473ae51d0d10 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:57.855443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:57.856625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:27:57.857599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 493/1003] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:57.862388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4221ad5-9022-4511-b75e-473ae51d0d10 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.863110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 511/1004] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/endpoints?service_id=0c916af19ea04f979ee7f06ed3ace1f3&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:57.868345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0986d1-9283-4af8-84b8-cba0ea096e0a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.975657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.981365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4221ad5-9022-4511-b75e-473ae51d0d10 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.984527 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0986d1-9283-4af8-84b8-cba0ea096e0a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:58.003430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:58.021402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cd513-6fc5-4093-baf9-711ff33da474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:58.021601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ce5e7-c355-43a7-8fec-38cb3bddb667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:58.021997 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ce5e7-c355-43a7-8fec-38cb3bddb667 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:58.022269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cd513-6fc5-4093-baf9-711ff33da474 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:58.022367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ce5e7-c355-43a7-8fec-38cb3bddb667 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:58.022540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ce5e7-c355-43a7-8fec-38cb3bddb667 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:58.022805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cd513-6fc5-4093-baf9-711ff33da474 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:58.023171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1cd513-6fc5-4093-baf9-711ff33da474 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:58.023259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ce5e7-c355-43a7-8fec-38cb3bddb667 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:58.024013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cd513-6fc5-4093-baf9-711ff33da474 None admin] RBAC: Adding query filter params (name=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:58.024435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cd513-6fc5-4093-baf9-711ff33da474 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:58.024594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ce5e7-c355-43a7-8fec-38cb3bddb667 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:58.025952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1cd513-6fc5-4093-baf9-711ff33da474 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:58.031816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 494/1005] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:58.037403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cd513-6fc5-4093-baf9-711ff33da474 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:58.040386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 512/1006] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:27:58.149814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1cd513-6fc5-4093-baf9-711ff33da474 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:58.186677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a8c03-25f1-4001-ba9a-d3a4f35bf806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:58.187307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a8c03-25f1-4001-ba9a-d3a4f35bf806 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:58.187591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a8c03-25f1-4001-ba9a-d3a4f35bf806 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:58.187869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a8c03-25f1-4001-ba9a-d3a4f35bf806 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:58.188620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a8c03-25f1-4001-ba9a-d3a4f35bf806 None admin] RBAC: Adding query filter params (type=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:58.189479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a8c03-25f1-4001-ba9a-d3a4f35bf806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:58.190839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a8c03-25f1-4001-ba9a-d3a4f35bf806 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:58.196296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 495/1007] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:59.568913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79049a-ba81-44c4-a234-564f129c341f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.569433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79049a-ba81-44c4-a234-564f129c341f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.569433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79049a-ba81-44c4-a234-564f129c341f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.570947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 513/1008] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:59.576507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f870c8d-d1d9-461e-b23e-413c62f304ec None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.577022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f870c8d-d1d9-461e-b23e-413c62f304ec None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.577102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f870c8d-d1d9-461e-b23e-413c62f304ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.600433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5f870c8d-d1d9-461e-b23e-413c62f304ec None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:59.601626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5f870c8d-d1d9-461e-b23e-413c62f304ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:59.629738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:59.680996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 496/1009] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:59 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:27:59.703724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79049a-ba81-44c4-a234-564f129c341f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:59.807401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79049a-ba81-44c4-a234-564f129c341f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:59.842161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4292fd-6b9c-4cb6-8d94-3126132ea612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:59.842726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4292fd-6b9c-4cb6-8d94-3126132ea612 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.843014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4292fd-6b9c-4cb6-8d94-3126132ea612 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.843287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4292fd-6b9c-4cb6-8d94-3126132ea612 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.844477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4292fd-6b9c-4cb6-8d94-3126132ea612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:59.845965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4292fd-6b9c-4cb6-8d94-3126132ea612 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:59.847691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 514/1010] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:59.853468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f870c8d-d1d9-461e-b23e-413c62f304ec None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:59.957531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f870c8d-d1d9-461e-b23e-413c62f304ec None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:59.991295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e348a0-451e-4903-a0d8-e9b87b25f9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:59.991915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e348a0-451e-4903-a0d8-e9b87b25f9e3 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.994090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e348a0-451e-4903-a0d8-e9b87b25f9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.994090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e348a0-451e-4903-a0d8-e9b87b25f9e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.994090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e348a0-451e-4903-a0d8-e9b87b25f9e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:59.994768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e348a0-451e-4903-a0d8-e9b87b25f9e3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.028174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 497/1011] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:27:59 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:00.049220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daef852-445b-48f3-afc7-1034b93fbd81 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.049576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daef852-445b-48f3-afc7-1034b93fbd81 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.049859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daef852-445b-48f3-afc7-1034b93fbd81 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.051523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 515/1012] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:00.057277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac0b6-ba9b-412a-8462-d489f9d3ff41 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.057647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac0b6-ba9b-412a-8462-d489f9d3ff41 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.057956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac0b6-ba9b-412a-8462-d489f9d3ff41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.078025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1f0ac0b6-ba9b-412a-8462-d489f9d3ff41 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:00.079305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1f0ac0b6-ba9b-412a-8462-d489f9d3ff41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:00.081999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.160524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 498/1013] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:00.183911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daef852-445b-48f3-afc7-1034b93fbd81 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.198796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fa594-3783-4173-960c-7b9a71957636 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.199094 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fa594-3783-4173-960c-7b9a71957636 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.199348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fa594-3783-4173-960c-7b9a71957636 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.200879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 499/1014] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:00.205978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52775c98-4bb2-418b-9c9d-a9274720bf7d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.206262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52775c98-4bb2-418b-9c9d-a9274720bf7d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.206541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52775c98-4bb2-418b-9c9d-a9274720bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.227791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-52775c98-4bb2-418b-9c9d-a9274720bf7d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:00.228503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-52775c98-4bb2-418b-9c9d-a9274720bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:00.242721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.299036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daef852-445b-48f3-afc7-1034b93fbd81 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.306192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 500/1015] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:00.322514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52775c98-4bb2-418b-9c9d-a9274720bf7d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.333916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02e84e-4588-4c92-96f8-93d04d7192b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.334554 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02e84e-4588-4c92-96f8-93d04d7192b2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.334832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02e84e-4588-4c92-96f8-93d04d7192b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.335097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02e84e-4588-4c92-96f8-93d04d7192b2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.335715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02e84e-4588-4c92-96f8-93d04d7192b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.337116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02e84e-4588-4c92-96f8-93d04d7192b2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-ce02e84e-4588-4c92-96f8-93d04d7192b2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:00.346510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:00.347668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:00.348535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 516/1016] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:00.353306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02e84e-4588-4c92-96f8-93d04d7192b2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.399117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.436301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52775c98-4bb2-418b-9c9d-a9274720bf7d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.459267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02e84e-4588-4c92-96f8-93d04d7192b2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.473855 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.476828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28610-97c6-4b5d-9ec2-58c3f392e3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.477737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28610-97c6-4b5d-9ec2-58c3f392e3ca None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.478019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28610-97c6-4b5d-9ec2-58c3f392e3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.478298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc28610-97c6-4b5d-9ec2-58c3f392e3ca None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.479001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc28610-97c6-4b5d-9ec2-58c3f392e3ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.480398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc28610-97c6-4b5d-9ec2-58c3f392e3ca None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.500203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 501/1017] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:00 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:28:00.511168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0507b-8917-4cd5-afed-cfe8c31b211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.511803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0507b-8917-4cd5-afed-cfe8c31b211a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.512079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0507b-8917-4cd5-afed-cfe8c31b211a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.512398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0507b-8917-4cd5-afed-cfe8c31b211a None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.513163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0507b-8917-4cd5-afed-cfe8c31b211a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:00.513577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0507b-8917-4cd5-afed-cfe8c31b211a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.515003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0507b-8917-4cd5-afed-cfe8c31b211a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.522284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 517/1018] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:00.528751 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28610-97c6-4b5d-9ec2-58c3f392e3ca None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.642292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc28610-97c6-4b5d-9ec2-58c3f392e3ca None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.672004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.681524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79ffb91-3b98-49ce-995b-6ecb19514674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.682148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ffb91-3b98-49ce-995b-6ecb19514674 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.682885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ffb91-3b98-49ce-995b-6ecb19514674 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.682885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ffb91-3b98-49ce-995b-6ecb19514674 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.683356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ffb91-3b98-49ce-995b-6ecb19514674 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:00.683656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ffb91-3b98-49ce-995b-6ecb19514674 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.685552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79ffb91-3b98-49ce-995b-6ecb19514674 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.690182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 502/1019] 10.222.0.57 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:00.695835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0507b-8917-4cd5-afed-cfe8c31b211a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.801322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0507b-8917-4cd5-afed-cfe8c31b211a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.838634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87f35a-1170-429e-8c98-45ea5b107ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.839257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f35a-1170-429e-8c98-45ea5b107ecd None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.839540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f35a-1170-429e-8c98-45ea5b107ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.839817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f35a-1170-429e-8c98-45ea5b107ecd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.840564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87f35a-1170-429e-8c98-45ea5b107ecd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.841939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87f35a-1170-429e-8c98-45ea5b107ecd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.862451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 518/1020] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:28:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:02.086154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e097a6-ead8-4d1e-a4c7-6d857852b02a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.086652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e097a6-ead8-4d1e-a4c7-6d857852b02a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.086652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e097a6-ead8-4d1e-a4c7-6d857852b02a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.088014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 503/1021] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:02.093155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a330e3-9df8-4d9a-83d6-3ae04b69a94b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.093535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a330e3-9df8-4d9a-83d6-3ae04b69a94b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.093719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a330e3-9df8-4d9a-83d6-3ae04b69a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.112531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a5a330e3-9df8-4d9a-83d6-3ae04b69a94b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:02.113724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a5a330e3-9df8-4d9a-83d6-3ae04b69a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:02.138420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.191873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 519/1022] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:02.215996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e097a6-ead8-4d1e-a4c7-6d857852b02a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.326113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e097a6-ead8-4d1e-a4c7-6d857852b02a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.361866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75f9328-afe6-4ee3-b16e-f870b40f2694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.362426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f9328-afe6-4ee3-b16e-f870b40f2694 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.362706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f9328-afe6-4ee3-b16e-f870b40f2694 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.362979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75f9328-afe6-4ee3-b16e-f870b40f2694 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.364156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f9328-afe6-4ee3-b16e-f870b40f2694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.365583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75f9328-afe6-4ee3-b16e-f870b40f2694 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.372119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 504/1023] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:02.373150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a330e3-9df8-4d9a-83d6-3ae04b69a94b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.478097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a330e3-9df8-4d9a-83d6-3ae04b69a94b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.512267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28fdd-6260-4338-b740-d2d379ae8fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.512887 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28fdd-6260-4338-b740-d2d379ae8fcd None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.513167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28fdd-6260-4338-b740-d2d379ae8fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.513438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28fdd-6260-4338-b740-d2d379ae8fcd None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.514116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae28fdd-6260-4338-b740-d2d379ae8fcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.515541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae28fdd-6260-4338-b740-d2d379ae8fcd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.539852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 520/1024] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:28:02 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:02.548393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07870189-2cbd-4c2f-8143-3c6277918c7d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.548393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07870189-2cbd-4c2f-8143-3c6277918c7d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.548393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07870189-2cbd-4c2f-8143-3c6277918c7d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.548393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 505/1025] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:02.550002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433fcf-2a56-4e6e-9e6a-9bb4558db190 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.550289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433fcf-2a56-4e6e-9e6a-9bb4558db190 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.550566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433fcf-2a56-4e6e-9e6a-9bb4558db190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.570679 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f9433fcf-2a56-4e6e-9e6a-9bb4558db190 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:02.571916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f9433fcf-2a56-4e6e-9e6a-9bb4558db190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:02.638904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.656594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 506/1026] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:02.679471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28fdd-6260-4338-b740-d2d379ae8fcd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.696538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.789934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28fdd-6260-4338-b740-d2d379ae8fcd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.830026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699a79d-8f4b-450f-97dd-43c587283add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.830675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a79d-8f4b-450f-97dd-43c587283add None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.830957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a79d-8f4b-450f-97dd-43c587283add None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.831230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699a79d-8f4b-450f-97dd-43c587283add None admin] PATH_INFO: `/v3/services/image` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.831859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699a79d-8f4b-450f-97dd-43c587283add None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.833270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699a79d-8f4b-450f-97dd-43c587283add None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-8699a79d-8f4b-450f-97dd-43c587283add None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:02.842294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:02.843282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:02.844101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 521/1027] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:02.849527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433fcf-2a56-4e6e-9e6a-9bb4558db190 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.956161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433fcf-2a56-4e6e-9e6a-9bb4558db190 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.976667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c19a4-af7f-4116-9f39-85818f390e71 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.976956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c19a4-af7f-4116-9f39-85818f390e71 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.977237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c19a4-af7f-4116-9f39-85818f390e71 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.978718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 522/1028] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:02.983467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd259827-84bf-4538-9d95-f128d4fd2bf3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.983754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd259827-84bf-4538-9d95-f128d4fd2bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.984032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd259827-84bf-4538-9d95-f128d4fd2bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.992576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b24bd-d5ee-4609-bf04-cef736a557a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.993203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b24bd-d5ee-4609-bf04-cef736a557a5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.993482 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b24bd-d5ee-4609-bf04-cef736a557a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.993749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b24bd-d5ee-4609-bf04-cef736a557a5 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.994425 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b24bd-d5ee-4609-bf04-cef736a557a5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:02.994727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b24bd-d5ee-4609-bf04-cef736a557a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.996079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b24bd-d5ee-4609-bf04-cef736a557a5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.001690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 507/1029] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:03.003336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-cd259827-84bf-4538-9d95-f128d4fd2bf3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:03.004573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cd259827-84bf-4538-9d95-f128d4fd2bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:03.007091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b24bd-d5ee-4609-bf04-cef736a557a5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.066464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.079684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 523/1030] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:03.102674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd259827-84bf-4538-9d95-f128d4fd2bf3 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.111649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.121177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b24bd-d5ee-4609-bf04-cef736a557a5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.156107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c02f-2170-4b63-9f0b-2c65747c4938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.156750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c02f-2170-4b63-9f0b-2c65747c4938 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.157030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c02f-2170-4b63-9f0b-2c65747c4938 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.157841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91c02f-2170-4b63-9f0b-2c65747c4938 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.158624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c02f-2170-4b63-9f0b-2c65747c4938 None admin] RBAC: Adding query filter params (type=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:03.158929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c02f-2170-4b63-9f0b-2c65747c4938 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.160305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91c02f-2170-4b63-9f0b-2c65747c4938 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.165856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 508/1031] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:03.171220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c02f-2170-4b63-9f0b-2c65747c4938 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.212885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd259827-84bf-4538-9d95-f128d4fd2bf3 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.248042 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb431cd-e534-4d80-9161-606d1802eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.248721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb431cd-e534-4d80-9161-606d1802eb81 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.249004 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb431cd-e534-4d80-9161-606d1802eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.249297 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb431cd-e534-4d80-9161-606d1802eb81 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.260698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb431cd-e534-4d80-9161-606d1802eb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-6bb431cd-e534-4d80-9161-606d1802eb81 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:03.266301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:03.267233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:03.268166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 524/1032] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:03.273288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb431cd-e534-4d80-9161-606d1802eb81 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.277084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91c02f-2170-4b63-9f0b-2c65747c4938 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.296581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.316070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122760e5-badb-40b2-9e25-58dbdee8f8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.316722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122760e5-badb-40b2-9e25-58dbdee8f8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.317413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122760e5-badb-40b2-9e25-58dbdee8f8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.317692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122760e5-badb-40b2-9e25-58dbdee8f8d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.318444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122760e5-badb-40b2-9e25-58dbdee8f8d2 None admin] RBAC: Adding query filter params (interface=public, service_id=bfa6b1c8516a47f2abdcd8668f01df65, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:03.318752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122760e5-badb-40b2-9e25-58dbdee8f8d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.320569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122760e5-badb-40b2-9e25-58dbdee8f8d2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.326582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 509/1033] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/endpoints?service_id=bfa6b1c8516a47f2abdcd8668f01df65&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:03.333043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122760e5-badb-40b2-9e25-58dbdee8f8d2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.349897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.385522 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb431cd-e534-4d80-9161-606d1802eb81 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.421132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1922686-9cfb-487f-941c-44ba7217b54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.422151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1922686-9cfb-487f-941c-44ba7217b54a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.422652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1922686-9cfb-487f-941c-44ba7217b54a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.423698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1922686-9cfb-487f-941c-44ba7217b54a None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.425025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1922686-9cfb-487f-941c-44ba7217b54a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:03.425605 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1922686-9cfb-487f-941c-44ba7217b54a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.428219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1922686-9cfb-487f-941c-44ba7217b54a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.439640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 525/1034] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:03.445053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122760e5-badb-40b2-9e25-58dbdee8f8d2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.448174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1922686-9cfb-487f-941c-44ba7217b54a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.484205 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee087e-3ebc-4b6d-a546-bc6e438ebc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.484857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee087e-3ebc-4b6d-a546-bc6e438ebc3d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.485206 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee087e-3ebc-4b6d-a546-bc6e438ebc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.486084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee087e-3ebc-4b6d-a546-bc6e438ebc3d None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.486807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee087e-3ebc-4b6d-a546-bc6e438ebc3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.488280 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee087e-3ebc-4b6d-a546-bc6e438ebc3d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.504161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 510/1035] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:28:03.566667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1922686-9cfb-487f-941c-44ba7217b54a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.595247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.605048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34efa56-504f-4f70-b686-32dc81add5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.605722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34efa56-504f-4f70-b686-32dc81add5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.605996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34efa56-504f-4f70-b686-32dc81add5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.606270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34efa56-504f-4f70-b686-32dc81add5c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.618282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34efa56-504f-4f70-b686-32dc81add5c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.619768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34efa56-504f-4f70-b686-32dc81add5c4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-a34efa56-504f-4f70-b686-32dc81add5c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:03.635161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:03.636105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:03.641285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:03.641285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:03.641285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:03.641285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:03.641285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 526/1036] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:03.644247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee087e-3ebc-4b6d-a546-bc6e438ebc3d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.695077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.752400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee087e-3ebc-4b6d-a546-bc6e438ebc3d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.787310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3facf-d47b-43cd-ae79-4bfbc4b153cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.787930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3facf-d47b-43cd-ae79-4bfbc4b153cc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.788246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3facf-d47b-43cd-ae79-4bfbc4b153cc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.788520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3facf-d47b-43cd-ae79-4bfbc4b153cc None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.789197 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3facf-d47b-43cd-ae79-4bfbc4b153cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:03.789501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3facf-d47b-43cd-ae79-4bfbc4b153cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.790852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba3facf-d47b-43cd-ae79-4bfbc4b153cc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.803958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 511/1037] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:03.809972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34efa56-504f-4f70-b686-32dc81add5c4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.916664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34efa56-504f-4f70-b686-32dc81add5c4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.952595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab33aa-048f-4df2-9a8d-525b75312af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.953569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab33aa-048f-4df2-9a8d-525b75312af8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.954675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab33aa-048f-4df2-9a8d-525b75312af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.955366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab33aa-048f-4df2-9a8d-525b75312af8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.963902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab33aa-048f-4df2-9a8d-525b75312af8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.965651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab33aa-048f-4df2-9a8d-525b75312af8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-96ab33aa-048f-4df2-9a8d-525b75312af8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:03.977389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:03.978312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:03.979242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:03.984910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 527/1038] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:03.986078 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3facf-d47b-43cd-ae79-4bfbc4b153cc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.090001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3facf-d47b-43cd-ae79-4bfbc4b153cc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.096893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.125304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72492f70-2e8e-42ac-979d-1bed7c1a4b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.126465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72492f70-2e8e-42ac-979d-1bed7c1a4b69 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.126683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72492f70-2e8e-42ac-979d-1bed7c1a4b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.126955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72492f70-2e8e-42ac-979d-1bed7c1a4b69 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.127736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72492f70-2e8e-42ac-979d-1bed7c1a4b69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:04.128045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72492f70-2e8e-42ac-979d-1bed7c1a4b69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.129509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72492f70-2e8e-42ac-979d-1bed7c1a4b69 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.152308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 512/1039] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:04.153257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab33aa-048f-4df2-9a8d-525b75312af8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.197327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.261938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab33aa-048f-4df2-9a8d-525b75312af8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.296194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cedbe-e4fe-4949-816f-b20e7440ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.296790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cedbe-e4fe-4949-816f-b20e7440ecba None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.297071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cedbe-e4fe-4949-816f-b20e7440ecba None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.297343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cedbe-e4fe-4949-816f-b20e7440ecba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.365906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cedbe-e4fe-4949-816f-b20e7440ecba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.367279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cedbe-e4fe-4949-816f-b20e7440ecba None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.406880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.466882 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 528/1040] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:28:04.473172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72492f70-2e8e-42ac-979d-1bed7c1a4b69 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.575035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72492f70-2e8e-42ac-979d-1bed7c1a4b69 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.609894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f07c9d-a96e-49c8-954e-618ef94466c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.611122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f07c9d-a96e-49c8-954e-618ef94466c9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.611407 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f07c9d-a96e-49c8-954e-618ef94466c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.611672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f07c9d-a96e-49c8-954e-618ef94466c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.623397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f07c9d-a96e-49c8-954e-618ef94466c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.624799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f07c9d-a96e-49c8-954e-618ef94466c9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.631597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ff4b-0d12-4c7d-9be2-f3f406550488 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.631889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ff4b-0d12-4c7d-9be2-f3f406550488 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.632186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310ff4b-0d12-4c7d-9be2-f3f406550488 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.633664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 529/1041] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:04.638346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4c09-c18c-4c76-8472-8704e417c0af None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.638635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4c09-c18c-4c76-8472-8704e417c0af None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.638912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b4c09-c18c-4c76-8472-8704e417c0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-a9f07c9d-a96e-49c8-954e-618ef94466c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:04.640392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:04.641256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:04.642117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:04.642117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:04.642117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:04.642117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:04.642117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 513/1042] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:04.648253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f07c9d-a96e-49c8-954e-618ef94466c9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.658602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ce9b4c09-c18c-4c76-8472-8704e417c0af None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:04.659788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ce9b4c09-c18c-4c76-8472-8704e417c0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:04.667533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.727952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 530/1043] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:04 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:04.751308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4c09-c18c-4c76-8472-8704e417c0af None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.752648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f07c9d-a96e-49c8-954e-618ef94466c9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.789221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa74e76-a29f-42f1-a7e3-275b2864117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.789837 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa74e76-a29f-42f1-a7e3-275b2864117e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.790117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa74e76-a29f-42f1-a7e3-275b2864117e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.790392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa74e76-a29f-42f1-a7e3-275b2864117e None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.791085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa74e76-a29f-42f1-a7e3-275b2864117e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:04.791391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa74e76-a29f-42f1-a7e3-275b2864117e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.792780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa74e76-a29f-42f1-a7e3-275b2864117e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.807912 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 514/1044] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:04.813032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa74e76-a29f-42f1-a7e3-275b2864117e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.825603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.861337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b4c09-c18c-4c76-8472-8704e417c0af None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.890967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.898254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d7488-35e9-4196-bbaf-db935196ba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.898900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d7488-35e9-4196-bbaf-db935196ba4a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.899182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d7488-35e9-4196-bbaf-db935196ba4a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.899456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d7488-35e9-4196-bbaf-db935196ba4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.910813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d7488-35e9-4196-bbaf-db935196ba4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:04.915732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa74e76-a29f-42f1-a7e3-275b2864117e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-808d7488-35e9-4196-bbaf-db935196ba4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:04.915853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:04.916894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:04.917721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 531/1045] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:04.923583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d7488-35e9-4196-bbaf-db935196ba4a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.954854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fcea9-06be-4be9-a1dc-c294e6715ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.955556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fcea9-06be-4be9-a1dc-c294e6715ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.955844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fcea9-06be-4be9-a1dc-c294e6715ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.956142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fcea9-06be-4be9-a1dc-c294e6715ee1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.963019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fcea9-06be-4be9-a1dc-c294e6715ee1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.964538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fcea9-06be-4be9-a1dc-c294e6715ee1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c38fcea9-06be-4be9-a1dc-c294e6715ee1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:04.976917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:04.977780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:04.978671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:04.978671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:04.978671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:04.978671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:04.978671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:04.978671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:04.978671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:04.978671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:04.982953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 515/1046] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:04.983792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fcea9-06be-4be9-a1dc-c294e6715ee1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.028304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d7488-35e9-4196-bbaf-db935196ba4a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.062482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.069894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e7e92-45ef-4eaf-8304-ff4a74f941fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.070515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e7e92-45ef-4eaf-8304-ff4a74f941fd None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.070819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e7e92-45ef-4eaf-8304-ff4a74f941fd None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.071089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e7e92-45ef-4eaf-8304-ff4a74f941fd None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.072284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e7e92-45ef-4eaf-8304-ff4a74f941fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:05.072594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e7e92-45ef-4eaf-8304-ff4a74f941fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.074323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e7e92-45ef-4eaf-8304-ff4a74f941fd None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.084515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 532/1047] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:05.090136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e7e92-45ef-4eaf-8304-ff4a74f941fd None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.102207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fcea9-06be-4be9-a1dc-c294e6715ee1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.137337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c11f9c-b8e4-4f50-85c8-ccdc6fbd36d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.137990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11f9c-b8e4-4f50-85c8-ccdc6fbd36d5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.138278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11f9c-b8e4-4f50-85c8-ccdc6fbd36d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.138547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c11f9c-b8e4-4f50-85c8-ccdc6fbd36d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.139321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c11f9c-b8e4-4f50-85c8-ccdc6fbd36d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:05.139594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c11f9c-b8e4-4f50-85c8-ccdc6fbd36d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.141099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c11f9c-b8e4-4f50-85c8-ccdc6fbd36d5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.144279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.154635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 516/1048] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:05.161627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c11f9c-b8e4-4f50-85c8-ccdc6fbd36d5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.201916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e7e92-45ef-4eaf-8304-ff4a74f941fd None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.235896 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce49281-99b7-4223-bbdf-f80ebf772dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.236562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce49281-99b7-4223-bbdf-f80ebf772dba None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.236842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce49281-99b7-4223-bbdf-f80ebf772dba None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.237117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce49281-99b7-4223-bbdf-f80ebf772dba None admin] PATH_INFO: `/v3/users/786bb4bb8ae24e9281e92184d77e00c5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.249830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce49281-99b7-4223-bbdf-f80ebf772dba None admin] RBAC: Authorizing `identity:get_user(user_id=786bb4bb8ae24e9281e92184d77e00c5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.251306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce49281-99b7-4223-bbdf-f80ebf772dba None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.253146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 533/1049] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/users/786bb4bb8ae24e9281e92184d77e00c5 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:05.258561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce49281-99b7-4223-bbdf-f80ebf772dba None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.273832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c11f9c-b8e4-4f50-85c8-ccdc6fbd36d5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.309034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.314712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6a5d4-8735-4ce9-b034-f3aa3e5688e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.315382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6a5d4-8735-4ce9-b034-f3aa3e5688e2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.315664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6a5d4-8735-4ce9-b034-f3aa3e5688e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.315985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6a5d4-8735-4ce9-b034-f3aa3e5688e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.316807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6a5d4-8735-4ce9-b034-f3aa3e5688e2 None admin] RBAC: Adding query filter params (role.id=aba8cdd000504e74bea65f7b87138d77, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=cab044fcd0dd449eafaccb81606d15ce) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:05.317117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6a5d4-8735-4ce9-b034-f3aa3e5688e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.318557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6a5d4-8735-4ce9-b034-f3aa3e5688e2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.332157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 517/1050] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/role_assignments?user.id=cab044fcd0dd449eafaccb81606d15ce&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=aba8cdd000504e74bea65f7b87138d77 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:05.372047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce49281-99b7-4223-bbdf-f80ebf772dba None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.410443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f8150-524a-4a92-b35d-765ed410783a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.410983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f8150-524a-4a92-b35d-765ed410783a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.411265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f8150-524a-4a92-b35d-765ed410783a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.411538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f8150-524a-4a92-b35d-765ed410783a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.483112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f8150-524a-4a92-b35d-765ed410783a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.484734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f8150-524a-4a92-b35d-765ed410783a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.512941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff85e1-2b78-425a-bbcf-c3d72d1139ef None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.513258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff85e1-2b78-425a-bbcf-c3d72d1139ef None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.513491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff85e1-2b78-425a-bbcf-c3d72d1139ef None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.514842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 518/1051] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:05.520392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a232-ca4f-445d-acb2-871bc3f8f4c2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.520679 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a232-ca4f-445d-acb2-871bc3f8f4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.520954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9a232-ca4f-445d-acb2-871bc3f8f4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.539447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cdf9a232-ca4f-445d-acb2-871bc3f8f4c2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:05.540670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cdf9a232-ca4f-445d-acb2-871bc3f8f4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:05.541014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.601147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 534/1052] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:28:05.602185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f8150-524a-4a92-b35d-765ed410783a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.607483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.620211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 519/1053] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:05.643691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9a232-ca4f-445d-acb2-871bc3f8f4c2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.710051 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f8150-524a-4a92-b35d-765ed410783a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.744245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942e591-0d47-48be-b210-5f5e18f29d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.744898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942e591-0d47-48be-b210-5f5e18f29d68 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.745182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942e591-0d47-48be-b210-5f5e18f29d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.745460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4942e591-0d47-48be-b210-5f5e18f29d68 None admin] PATH_INFO: `/v3/projects/2c8351693195496dba80f67c15cef480` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.746618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942e591-0d47-48be-b210-5f5e18f29d68 None admin] RBAC: Authorizing `identity:get_project(project_id=2c8351693195496dba80f67c15cef480)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.746909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9a232-ca4f-445d-acb2-871bc3f8f4c2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.748061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4942e591-0d47-48be-b210-5f5e18f29d68 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.750038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 535/1054] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/projects/2c8351693195496dba80f67c15cef480 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:05.756228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942e591-0d47-48be-b210-5f5e18f29d68 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.777786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.784888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9fa6a-0f4d-4c27-a082-5254eaf0c1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.785539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9fa6a-0f4d-4c27-a082-5254eaf0c1cf None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.785828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9fa6a-0f4d-4c27-a082-5254eaf0c1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.786103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9fa6a-0f4d-4c27-a082-5254eaf0c1cf None admin] PATH_INFO: `/v3/services/image` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.786739 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9fa6a-0f4d-4c27-a082-5254eaf0c1cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.788091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9fa6a-0f4d-4c27-a082-5254eaf0c1cf None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3cb9fa6a-0f4d-4c27-a082-5254eaf0c1cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:05.798543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:05.799615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:05.800490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 520/1055] 10.222.0.57 () {56 vars in 1105 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:05.805119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9fa6a-0f4d-4c27-a082-5254eaf0c1cf None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.866039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.877860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4942e591-0d47-48be-b210-5f5e18f29d68 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.911225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb99cb-3fb2-46cf-96ba-60b9d0cf141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.911838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb99cb-3fb2-46cf-96ba-60b9d0cf141d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.912119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb99cb-3fb2-46cf-96ba-60b9d0cf141d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.912419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb99cb-3fb2-46cf-96ba-60b9d0cf141d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.912711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9fa6a-0f4d-4c27-a082-5254eaf0c1cf None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.913202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb99cb-3fb2-46cf-96ba-60b9d0cf141d None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=2c8351693195496dba80f67c15cef480, user.id=786bb4bb8ae24e9281e92184d77e00c5) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:05.913512 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb99cb-3fb2-46cf-96ba-60b9d0cf141d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.914956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb99cb-3fb2-46cf-96ba-60b9d0cf141d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.920353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 536/1056] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/role_assignments?user.id=786bb4bb8ae24e9281e92184d77e00c5&scope.project.id=2c8351693195496dba80f67c15cef480&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:05.957852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612519-4ffe-4514-b98b-ba85060a8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.958491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612519-4ffe-4514-b98b-ba85060a8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.958774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612519-4ffe-4514-b98b-ba85060a8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.959051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612519-4ffe-4514-b98b-ba85060a8cb2 None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.959748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b612519-4ffe-4514-b98b-ba85060a8cb2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:05.960109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b612519-4ffe-4514-b98b-ba85060a8cb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.961499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b612519-4ffe-4514-b98b-ba85060a8cb2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.972400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 521/1057] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:05.973274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb99cb-3fb2-46cf-96ba-60b9d0cf141d None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.089912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.109298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb99cb-3fb2-46cf-96ba-60b9d0cf141d None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.143135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395e53c-4294-4613-a8da-0a00e80f748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.143758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395e53c-4294-4613-a8da-0a00e80f748a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.144050 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395e53c-4294-4613-a8da-0a00e80f748a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.144349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395e53c-4294-4613-a8da-0a00e80f748a None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.145029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395e53c-4294-4613-a8da-0a00e80f748a None admin] RBAC: Adding query filter params (type=image) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:06.145344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395e53c-4294-4613-a8da-0a00e80f748a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.146712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395e53c-4294-4613-a8da-0a00e80f748a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.156586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 537/1058] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:06.158108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612519-4ffe-4514-b98b-ba85060a8cb2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.257684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612519-4ffe-4514-b98b-ba85060a8cb2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.274569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.293273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf2145-ff3c-405e-a13e-5d1134dc3e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.293896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf2145-ff3c-405e-a13e-5d1134dc3e87 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.294179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf2145-ff3c-405e-a13e-5d1134dc3e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.294454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf2145-ff3c-405e-a13e-5d1134dc3e87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.295174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf2145-ff3c-405e-a13e-5d1134dc3e87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.296565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf2145-ff3c-405e-a13e-5d1134dc3e87 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.323898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 522/1059] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:28:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:28:07.322860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fa3d5-9941-46b2-b39d-9e02320e5c35 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.323371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fa3d5-9941-46b2-b39d-9e02320e5c35 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.323448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574fa3d5-9941-46b2-b39d-9e02320e5c35 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.328162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 538/1060] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:07.330641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41108d2-6e6a-4792-8fff-efbcf116741f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.331070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41108d2-6e6a-4792-8fff-efbcf116741f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.331234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41108d2-6e6a-4792-8fff-efbcf116741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.349681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c41108d2-6e6a-4792-8fff-efbcf116741f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:07.350853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c41108d2-6e6a-4792-8fff-efbcf116741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:07.440211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 523/1061] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:07.462120 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fa3d5-9941-46b2-b39d-9e02320e5c35 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.564102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574fa3d5-9941-46b2-b39d-9e02320e5c35 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.597653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d516bb8-33bc-45a1-bdcf-642fb2258b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.598206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516bb8-33bc-45a1-bdcf-642fb2258b48 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.598485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516bb8-33bc-45a1-bdcf-642fb2258b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.598755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d516bb8-33bc-45a1-bdcf-642fb2258b48 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.608667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d516bb8-33bc-45a1-bdcf-642fb2258b48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3d516bb8-33bc-45a1-bdcf-642fb2258b48 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:07.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:07.614509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:07.620353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 539/1062] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:07.622773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41108d2-6e6a-4792-8fff-efbcf116741f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.721482 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:07.725082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41108d2-6e6a-4792-8fff-efbcf116741f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.760152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d02fa-36ec-4ceb-a128-c825787be881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.760814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d02fa-36ec-4ceb-a128-c825787be881 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.761094 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d02fa-36ec-4ceb-a128-c825787be881 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.761427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d02fa-36ec-4ceb-a128-c825787be881 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.762161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d02fa-36ec-4ceb-a128-c825787be881 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:07.762466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d02fa-36ec-4ceb-a128-c825787be881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.763843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d02fa-36ec-4ceb-a128-c825787be881 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.779541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 524/1063] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:07.781003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d516bb8-33bc-45a1-bdcf-642fb2258b48 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.791270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:07.894235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d516bb8-33bc-45a1-bdcf-642fb2258b48 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.928635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85345e66-7a0c-4466-80b8-dedae2211e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.929282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345e66-7a0c-4466-80b8-dedae2211e3e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.929565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345e66-7a0c-4466-80b8-dedae2211e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.929841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345e66-7a0c-4466-80b8-dedae2211e3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.929964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8f3c2-d43e-45dd-8cc7-461cf1147565 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.930235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8f3c2-d43e-45dd-8cc7-461cf1147565 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.930628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8f3c2-d43e-45dd-8cc7-461cf1147565 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.932210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 525/1064] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:07.937653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf71ae-0c77-47de-a173-12c6ae9bb5b1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.937934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf71ae-0c77-47de-a173-12c6ae9bb5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.938692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf71ae-0c77-47de-a173-12c6ae9bb5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.944707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85345e66-7a0c-4466-80b8-dedae2211e3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.947523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85345e66-7a0c-4466-80b8-dedae2211e3e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.958158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-bfcf71ae-0c77-47de-a173-12c6ae9bb5b1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:07.959347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bfcf71ae-0c77-47de-a173-12c6ae9bb5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-85345e66-7a0c-4466-80b8-dedae2211e3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:07.965620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:07.966667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:07.967783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:07.967783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:07.967783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:07.967783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:07.972278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 540/1065] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:07.975216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85345e66-7a0c-4466-80b8-dedae2211e3e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.036305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 526/1066] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:08.039571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.057743 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf71ae-0c77-47de-a173-12c6ae9bb5b1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.086343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85345e66-7a0c-4466-80b8-dedae2211e3e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.122972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699023b5-5472-4fed-a4e3-2b7dbefa81e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.123592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699023b5-5472-4fed-a4e3-2b7dbefa81e4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.123877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699023b5-5472-4fed-a4e3-2b7dbefa81e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.124179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699023b5-5472-4fed-a4e3-2b7dbefa81e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.124880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699023b5-5472-4fed-a4e3-2b7dbefa81e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:08.125189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699023b5-5472-4fed-a4e3-2b7dbefa81e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.127130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699023b5-5472-4fed-a4e3-2b7dbefa81e4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.139230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 541/1067] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:08.144817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699023b5-5472-4fed-a4e3-2b7dbefa81e4 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.161128 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.173323 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf71ae-0c77-47de-a173-12c6ae9bb5b1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.212586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40d080-7c58-49e4-bbd7-04cb292449a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.213349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d080-7c58-49e4-bbd7-04cb292449a1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.213632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d080-7c58-49e4-bbd7-04cb292449a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.214022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40d080-7c58-49e4-bbd7-04cb292449a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.226001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40d080-7c58-49e4-bbd7-04cb292449a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ca40d080-7c58-49e4-bbd7-04cb292449a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:08.231060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:08.231955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:08.233636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 527/1068] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:08.238684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40d080-7c58-49e4-bbd7-04cb292449a1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.253589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699023b5-5472-4fed-a4e3-2b7dbefa81e4 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.272347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.290848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed7195-9596-4f2b-b4b3-3f80aeb8df1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.291489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed7195-9596-4f2b-b4b3-3f80aeb8df1a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.291773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed7195-9596-4f2b-b4b3-3f80aeb8df1a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.292048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed7195-9596-4f2b-b4b3-3f80aeb8df1a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.300023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed7195-9596-4f2b-b4b3-3f80aeb8df1a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.301501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed7195-9596-4f2b-b4b3-3f80aeb8df1a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-10ed7195-9596-4f2b-b4b3-3f80aeb8df1a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:08.314083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:08.315010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:08.316363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 542/1069] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:08.320957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed7195-9596-4f2b-b4b3-3f80aeb8df1a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.347635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40d080-7c58-49e4-bbd7-04cb292449a1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.382266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9bb87-dc64-4924-ba45-4cb852558595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.382878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9bb87-dc64-4924-ba45-4cb852558595 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.383161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9bb87-dc64-4924-ba45-4cb852558595 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.383435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9bb87-dc64-4924-ba45-4cb852558595 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.384164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9bb87-dc64-4924-ba45-4cb852558595 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:08.384476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9bb87-dc64-4924-ba45-4cb852558595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.385832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9bb87-dc64-4924-ba45-4cb852558595 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.393764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 528/1070] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:08.394972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c1d7c-6cb8-4ae4-88aa-22963c3146f2 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.395208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c1d7c-6cb8-4ae4-88aa-22963c3146f2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.395483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c1d7c-6cb8-4ae4-88aa-22963c3146f2 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.396870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 529/1071] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:08.401090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c1d7c-6cb8-4ae4-88aa-22963c3146f2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.417020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.423161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed7195-9596-4f2b-b4b3-3f80aeb8df1a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.457056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779a2ad-b410-4587-b421-5d25d62e1aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.457670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a2ad-b410-4587-b421-5d25d62e1aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.457954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a2ad-b410-4587-b421-5d25d62e1aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.458235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779a2ad-b410-4587-b421-5d25d62e1aa5 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.459026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a2ad-b410-4587-b421-5d25d62e1aa5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:08.459334 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a2ad-b410-4587-b421-5d25d62e1aa5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.460805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779a2ad-b410-4587-b421-5d25d62e1aa5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.478322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 543/1072] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:08.480027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd863-22bc-46d2-ad2a-a6e8faf2c514 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.480343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd863-22bc-46d2-ad2a-a6e8faf2c514 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.480633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbbd863-22bc-46d2-ad2a-a6e8faf2c514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.499121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3bbbd863-22bc-46d2-ad2a-a6e8faf2c514 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:08.500346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3bbbd863-22bc-46d2-ad2a-a6e8faf2c514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:08.506015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c1d7c-6cb8-4ae4-88aa-22963c3146f2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.527783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.539514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb76ac-e210-4865-a7b0-d18d18a51f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.540177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb76ac-e210-4865-a7b0-d18d18a51f50 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.540463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb76ac-e210-4865-a7b0-d18d18a51f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.540740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cb76ac-e210-4865-a7b0-d18d18a51f50 None admin] PATH_INFO: `/v3/users/786bb4bb8ae24e9281e92184d77e00c5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.541909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb76ac-e210-4865-a7b0-d18d18a51f50 None admin] RBAC: Authorizing `identity:get_user(user_id=786bb4bb8ae24e9281e92184d77e00c5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.543323 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cb76ac-e210-4865-a7b0-d18d18a51f50 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.544965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 530/1073] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/users/786bb4bb8ae24e9281e92184d77e00c5 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:08.545722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb76ac-e210-4865-a7b0-d18d18a51f50 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.568553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 544/1074] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:08.569398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbd863-22bc-46d2-ad2a-a6e8faf2c514 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.633637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.652452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cb76ac-e210-4865-a7b0-d18d18a51f50 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.672074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbbd863-22bc-46d2-ad2a-a6e8faf2c514 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.686927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bc497-55d9-4fbe-96b7-f62bd0cb84c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.687606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc497-55d9-4fbe-96b7-f62bd0cb84c1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.687906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc497-55d9-4fbe-96b7-f62bd0cb84c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.688231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bc497-55d9-4fbe-96b7-f62bd0cb84c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.698702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bc497-55d9-4fbe-96b7-f62bd0cb84c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.700157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404bc497-55d9-4fbe-96b7-f62bd0cb84c1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.705637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82dbd0-9971-475f-bf2e-a49d710feba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.706270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82dbd0-9971-475f-bf2e-a49d710feba3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.706551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82dbd0-9971-475f-bf2e-a49d710feba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.706825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82dbd0-9971-475f-bf2e-a49d710feba3 None admin] PATH_INFO: `/v3/projects/2c8351693195496dba80f67c15cef480` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.707963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82dbd0-9971-475f-bf2e-a49d710feba3 None admin] RBAC: Authorizing `identity:get_project(project_id=2c8351693195496dba80f67c15cef480)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.709407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82dbd0-9971-475f-bf2e-a49d710feba3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.711061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 545/1075] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/projects/2c8351693195496dba80f67c15cef480 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:08.711813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82dbd0-9971-475f-bf2e-a49d710feba3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-404bc497-55d9-4fbe-96b7-f62bd0cb84c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:08.714130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:08.715181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:08.716250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:08.716250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:08.716250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:08.716250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:08.716250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 531/1076] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:08.717446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bc497-55d9-4fbe-96b7-f62bd0cb84c1 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.747644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.813650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82dbd0-9971-475f-bf2e-a49d710feba3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.821397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bc497-55d9-4fbe-96b7-f62bd0cb84c1 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.847534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ac602-b238-4058-8288-d834f64dedd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.848176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ac602-b238-4058-8288-d834f64dedd8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.848466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ac602-b238-4058-8288-d834f64dedd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.848742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ac602-b238-4058-8288-d834f64dedd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.855828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cc25-6193-4b76-a9d9-364d53a9329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.856541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cc25-6193-4b76-a9d9-364d53a9329d None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.856819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cc25-6193-4b76-a9d9-364d53a9329d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.857092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8cc25-6193-4b76-a9d9-364d53a9329d None admin] PATH_INFO: `/v3/projects/2c8351693195496dba80f67c15cef480/users/786bb4bb8ae24e9281e92184d77e00c5/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.859012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8cc25-6193-4b76-a9d9-364d53a9329d None admin] RBAC: Authorizing `identity:create_grant(project_id=2c8351693195496dba80f67c15cef480, user_id=786bb4bb8ae24e9281e92184d77e00c5, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.860468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8cc25-6193-4b76-a9d9-364d53a9329d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.862730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.874612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 532/1077] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:08 2022] PUT /identity/v3/projects/2c8351693195496dba80f67c15cef480/users/786bb4bb8ae24e9281e92184d77e00c5/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:28:08.875625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cc25-6193-4b76-a9d9-364d53a9329d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.921256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ac602-b238-4058-8288-d834f64dedd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.923021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ac602-b238-4058-8288-d834f64dedd8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.961405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.992242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8cc25-6193-4b76-a9d9-364d53a9329d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.035381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32114bd6-5ed5-4580-9129-2a33b2a36ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.036320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32114bd6-5ed5-4580-9129-2a33b2a36ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.036603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32114bd6-5ed5-4580-9129-2a33b2a36ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.036874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32114bd6-5ed5-4580-9129-2a33b2a36ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.037573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32114bd6-5ed5-4580-9129-2a33b2a36ed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:09.037872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32114bd6-5ed5-4580-9129-2a33b2a36ed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.039311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32114bd6-5ed5-4580-9129-2a33b2a36ed5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.042546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 546/1078] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:09.048563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ac602-b238-4058-8288-d834f64dedd8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.053635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 533/1079] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:09.061317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32114bd6-5ed5-4580-9129-2a33b2a36ed5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.130634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.165942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ac602-b238-4058-8288-d834f64dedd8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.182442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32114bd6-5ed5-4580-9129-2a33b2a36ed5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.203505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2fd5f-990f-44f9-84bc-857528713950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.204359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2fd5f-990f-44f9-84bc-857528713950 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.204741 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2fd5f-990f-44f9-84bc-857528713950 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.205115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2fd5f-990f-44f9-84bc-857528713950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.207577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.217535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2fd5f-990f-44f9-84bc-857528713950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.218480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb33a-9f30-40e1-b817-9d7aab52284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.219151 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb33a-9f30-40e1-b817-9d7aab52284e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.219953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb33a-9f30-40e1-b817-9d7aab52284e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.220052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2fd5f-990f-44f9-84bc-857528713950 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.220258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fb33a-9f30-40e1-b817-9d7aab52284e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.227595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb33a-9f30-40e1-b817-9d7aab52284e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.229063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fb33a-9f30-40e1-b817-9d7aab52284e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-47f2fd5f-990f-44f9-84bc-857528713950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:09.236974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:09.238026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:09.239118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:09.239118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:09.239118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:09.239118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:09.245444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 547/1080] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-de5fb33a-9f30-40e1-b817-9d7aab52284e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:09.245566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:09.246381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:09.247551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:09.247551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:09.247551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:09.247551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:09.247551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:09.247551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:09.247551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:09.247551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:09.247551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 534/1081] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:09.248127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb33a-9f30-40e1-b817-9d7aab52284e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.248229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2fd5f-990f-44f9-84bc-857528713950 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.353628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fb33a-9f30-40e1-b817-9d7aab52284e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.357173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2fd5f-990f-44f9-84bc-857528713950 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.369086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.391214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665fab2-9ebb-42f7-843e-1fd276f8f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.391832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665fab2-9ebb-42f7-843e-1fd276f8f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.392115 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665fab2-9ebb-42f7-843e-1fd276f8f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.392428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665fab2-9ebb-42f7-843e-1fd276f8f8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.393167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665fab2-9ebb-42f7-843e-1fd276f8f8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:09.393468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665fab2-9ebb-42f7-843e-1fd276f8f8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.394879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665fab2-9ebb-42f7-843e-1fd276f8f8f6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.395163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68ca9d-3def-49f1-a9f5-3d3dac179a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.395781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68ca9d-3def-49f1-a9f5-3d3dac179a81 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.396064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68ca9d-3def-49f1-a9f5-3d3dac179a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.396373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68ca9d-3def-49f1-a9f5-3d3dac179a81 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.397074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68ca9d-3def-49f1-a9f5-3d3dac179a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:09.397381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68ca9d-3def-49f1-a9f5-3d3dac179a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.398730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68ca9d-3def-49f1-a9f5-3d3dac179a81 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.414268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 535/1082] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:09.415269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665fab2-9ebb-42f7-843e-1fd276f8f8f6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.416956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 548/1083] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:09.528740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665fab2-9ebb-42f7-843e-1fd276f8f8f6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.566674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f575c2-8db1-4a36-a866-bcdb27443dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.567349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f575c2-8db1-4a36-a866-bcdb27443dec None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.568380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f575c2-8db1-4a36-a866-bcdb27443dec None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.568380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f575c2-8db1-4a36-a866-bcdb27443dec None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/cab044fcd0dd449eafaccb81606d15ce/roles/aba8cdd000504e74bea65f7b87138d77` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.571565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f575c2-8db1-4a36-a866-bcdb27443dec None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=cab044fcd0dd449eafaccb81606d15ce, role_id=aba8cdd000504e74bea65f7b87138d77)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.573041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f575c2-8db1-4a36-a866-bcdb27443dec None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.587514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 536/1084] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:09 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/cab044fcd0dd449eafaccb81606d15ce/roles/aba8cdd000504e74bea65f7b87138d77 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:10.869573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff6f4a-a87a-4040-bbf7-72219b1995f4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.870072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff6f4a-a87a-4040-bbf7-72219b1995f4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.870166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff6f4a-a87a-4040-bbf7-72219b1995f4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.871456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 549/1085] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:10.876659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ac90b-241e-4c68-8a4e-6438b27b1fa9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.877035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ac90b-241e-4c68-8a4e-6438b27b1fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.877209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ac90b-241e-4c68-8a4e-6438b27b1fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.894669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-206ac90b-241e-4c68-8a4e-6438b27b1fa9 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:10.895837 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-206ac90b-241e-4c68-8a4e-6438b27b1fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:10.921895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:10.963054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 537/1086] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:10.986717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff6f4a-a87a-4040-bbf7-72219b1995f4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.033793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.090130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff6f4a-a87a-4040-bbf7-72219b1995f4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.124013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63071f9-c62e-4f3e-889a-a34c04ee4faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.124677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63071f9-c62e-4f3e-889a-a34c04ee4faa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.124957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63071f9-c62e-4f3e-889a-a34c04ee4faa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.125229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63071f9-c62e-4f3e-889a-a34c04ee4faa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.135082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63071f9-c62e-4f3e-889a-a34c04ee4faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-a63071f9-c62e-4f3e-889a-a34c04ee4faa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:11.139948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:11.140845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:11.142140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 550/1087] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:11.148996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ac90b-241e-4c68-8a4e-6438b27b1fa9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.243977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ac90b-241e-4c68-8a4e-6438b27b1fa9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.276816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592f40e-0f31-4b3a-ab5b-40431dc843d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.277432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f40e-0f31-4b3a-ab5b-40431dc843d6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.277710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f40e-0f31-4b3a-ab5b-40431dc843d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.277980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592f40e-0f31-4b3a-ab5b-40431dc843d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.278950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592f40e-0f31-4b3a-ab5b-40431dc843d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:11.279253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592f40e-0f31-4b3a-ab5b-40431dc843d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.280644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592f40e-0f31-4b3a-ab5b-40431dc843d6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.289444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 538/1088] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:11.295033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63071f9-c62e-4f3e-889a-a34c04ee4faa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.395526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63071f9-c62e-4f3e-889a-a34c04ee4faa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.402459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.428705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215bc8eb-d6ae-45d4-8578-c595dfb4d02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.429364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bc8eb-d6ae-45d4-8578-c595dfb4d02a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.429644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bc8eb-d6ae-45d4-8578-c595dfb4d02a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.429917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215bc8eb-d6ae-45d4-8578-c595dfb4d02a None admin] PATH_INFO: `/v3/users/786bb4bb8ae24e9281e92184d77e00c5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.431061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bc8eb-d6ae-45d4-8578-c595dfb4d02a None admin] RBAC: Authorizing `identity:get_user(user_id=786bb4bb8ae24e9281e92184d77e00c5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.432520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215bc8eb-d6ae-45d4-8578-c595dfb4d02a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.434100 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 551/1089] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/users/786bb4bb8ae24e9281e92184d77e00c5 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:11.440439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592f40e-0f31-4b3a-ab5b-40431dc843d6 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.467682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.538774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592f40e-0f31-4b3a-ab5b-40431dc843d6 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.571112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40009b31-a1c4-4d4c-9005-e08e8364a2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.571722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009b31-a1c4-4d4c-9005-e08e8364a2ce None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.572001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009b31-a1c4-4d4c-9005-e08e8364a2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.572307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009b31-a1c4-4d4c-9005-e08e8364a2ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.591669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7176236-9d6c-41e4-a096-3320f0c6bf1f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.591954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7176236-9d6c-41e4-a096-3320f0c6bf1f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.592258 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7176236-9d6c-41e4-a096-3320f0c6bf1f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.593597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 552/1090] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:11.598339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1ce44-f9b8-46aa-bd1d-af2f690364b5 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.598629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1ce44-f9b8-46aa-bd1d-af2f690364b5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.598905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1ce44-f9b8-46aa-bd1d-af2f690364b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.617244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-16e1ce44-f9b8-46aa-bd1d-af2f690364b5 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:11.618439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-16e1ce44-f9b8-46aa-bd1d-af2f690364b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:11.638430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40009b31-a1c4-4d4c-9005-e08e8364a2ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.639860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40009b31-a1c4-4d4c-9005-e08e8364a2ce None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.665704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.686836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 553/1091] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:11.710774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1ce44-f9b8-46aa-bd1d-af2f690364b5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.739932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 539/1092] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:11.745464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40009b31-a1c4-4d4c-9005-e08e8364a2ce None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.812199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1ce44-f9b8-46aa-bd1d-af2f690364b5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.815105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.845863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40009b31-a1c4-4d4c-9005-e08e8364a2ce None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.848060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e891fca-795a-44d0-be8d-97129e4e5861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.848731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e891fca-795a-44d0-be8d-97129e4e5861 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.849018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e891fca-795a-44d0-be8d-97129e4e5861 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.849295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e891fca-795a-44d0-be8d-97129e4e5861 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.859503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e891fca-795a-44d0-be8d-97129e4e5861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-1e891fca-795a-44d0-be8d-97129e4e5861 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:11.864950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:11.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:11.866895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 554/1093] 10.222.0.57 () {56 vars in 1120 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:11.871017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.872034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e891fca-795a-44d0-be8d-97129e4e5861 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.880607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7e12b-144a-42b5-83b6-4575575542fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.881247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7e12b-144a-42b5-83b6-4575575542fb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.881533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7e12b-144a-42b5-83b6-4575575542fb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.881810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7e12b-144a-42b5-83b6-4575575542fb None admin] PATH_INFO: `/v3/projects/2c8351693195496dba80f67c15cef480` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.882965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7e12b-144a-42b5-83b6-4575575542fb None admin] RBAC: Authorizing `identity:get_project(project_id=2c8351693195496dba80f67c15cef480)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.884450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7e12b-144a-42b5-83b6-4575575542fb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.886136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 540/1094] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/projects/2c8351693195496dba80f67c15cef480 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:11.892057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7e12b-144a-42b5-83b6-4575575542fb None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.972766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e891fca-795a-44d0-be8d-97129e4e5861 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.987775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7e12b-144a-42b5-83b6-4575575542fb None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.006583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25e571-69b9-41e7-97e2-c6b5ff864a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.007196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25e571-69b9-41e7-97e2-c6b5ff864a76 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.007484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25e571-69b9-41e7-97e2-c6b5ff864a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.007757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25e571-69b9-41e7-97e2-c6b5ff864a76 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.008507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25e571-69b9-41e7-97e2-c6b5ff864a76 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:12.008814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25e571-69b9-41e7-97e2-c6b5ff864a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.010174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25e571-69b9-41e7-97e2-c6b5ff864a76 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.018242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 555/1095] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:12.023829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25e571-69b9-41e7-97e2-c6b5ff864a76 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.025532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784322-6601-45e6-aea6-f6f69a329b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.026148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784322-6601-45e6-aea6-f6f69a329b1d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.026429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784322-6601-45e6-aea6-f6f69a329b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.026703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f784322-6601-45e6-aea6-f6f69a329b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.027489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f784322-6601-45e6-aea6-f6f69a329b1d None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=2c8351693195496dba80f67c15cef480, user.id=786bb4bb8ae24e9281e92184d77e00c5) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:12.027804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f784322-6601-45e6-aea6-f6f69a329b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.029508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f784322-6601-45e6-aea6-f6f69a329b1d None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.048174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 541/1096] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/role_assignments?user.id=786bb4bb8ae24e9281e92184d77e00c5&scope.project.id=2c8351693195496dba80f67c15cef480&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:12.051755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.130045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25e571-69b9-41e7-97e2-c6b5ff864a76 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.165319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a5761-f104-433b-a985-29a9543bfb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.165968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a5761-f104-433b-a985-29a9543bfb8f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.166244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a5761-f104-433b-a985-29a9543bfb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.166513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a5761-f104-433b-a985-29a9543bfb8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.178275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a5761-f104-433b-a985-29a9543bfb8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.179740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a5761-f104-433b-a985-29a9543bfb8f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-b68a5761-f104-433b-a985-29a9543bfb8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:12.194199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:12.195257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:12.196476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:12.196476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:12.196476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:12.196476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:12.196476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 556/1097] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:12.201121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784322-6601-45e6-aea6-f6f69a329b1d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.260181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.302413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f784322-6601-45e6-aea6-f6f69a329b1d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.334767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66162de9-a4d7-4755-a481-6d3e0c148770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.335378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66162de9-a4d7-4755-a481-6d3e0c148770 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.335661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66162de9-a4d7-4755-a481-6d3e0c148770 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.335934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66162de9-a4d7-4755-a481-6d3e0c148770 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.336648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66162de9-a4d7-4755-a481-6d3e0c148770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:12.336958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66162de9-a4d7-4755-a481-6d3e0c148770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.338315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66162de9-a4d7-4755-a481-6d3e0c148770 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.350293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 542/1098] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:12.355793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a5761-f104-433b-a985-29a9543bfb8f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.432231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.453795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a5761-f104-433b-a985-29a9543bfb8f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.487390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1ff7-1111-4c64-a83b-18b84b92d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.488026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1ff7-1111-4c64-a83b-18b84b92d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.488340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1ff7-1111-4c64-a83b-18b84b92d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.488617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf1ff7-1111-4c64-a83b-18b84b92d9b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.495899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf1ff7-1111-4c64-a83b-18b84b92d9b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.497404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf1ff7-1111-4c64-a83b-18b84b92d9b0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4abf1ff7-1111-4c64-a83b-18b84b92d9b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:12.508541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:12.509459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:12.510425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 557/1099] 10.222.0.57 () {56 vars in 1093 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:12.515515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66162de9-a4d7-4755-a481-6d3e0c148770 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.615093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66162de9-a4d7-4755-a481-6d3e0c148770 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.632003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.649544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad83b86-dd62-45f5-b0f6-301beee24e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.650161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad83b86-dd62-45f5-b0f6-301beee24e83 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.650443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad83b86-dd62-45f5-b0f6-301beee24e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.650718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad83b86-dd62-45f5-b0f6-301beee24e83 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.651502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad83b86-dd62-45f5-b0f6-301beee24e83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:12.651809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad83b86-dd62-45f5-b0f6-301beee24e83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.653517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad83b86-dd62-45f5-b0f6-301beee24e83 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.670697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 543/1100] 10.222.0.57 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:12.676474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1ff7-1111-4c64-a83b-18b84b92d9b0 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.774048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf1ff7-1111-4c64-a83b-18b84b92d9b0 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.809059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7b1c0-37d4-404d-b458-935044df3ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.809680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7b1c0-37d4-404d-b458-935044df3ecb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.809957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7b1c0-37d4-404d-b458-935044df3ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.810224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7b1c0-37d4-404d-b458-935044df3ecb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.818874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.876885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7b1c0-37d4-404d-b458-935044df3ecb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.878336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7b1c0-37d4-404d-b458-935044df3ecb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.972907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 558/1101] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:28:12.978804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad83b86-dd62-45f5-b0f6-301beee24e83 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.075093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad83b86-dd62-45f5-b0f6-301beee24e83 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.113371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f8e8c-5019-44b3-a685-f705c530ef89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.114011 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f8e8c-5019-44b3-a685-f705c530ef89 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.114293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f8e8c-5019-44b3-a685-f705c530ef89 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.114569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f8e8c-5019-44b3-a685-f705c530ef89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.124560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f8e8c-5019-44b3-a685-f705c530ef89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.126383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f8e8c-5019-44b3-a685-f705c530ef89 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-026f8e8c-5019-44b3-a685-f705c530ef89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:13.143116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:13.144040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:13.144963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:13.144963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:13.144963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:13.144963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:13.144963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 544/1102] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:13.150176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7b1c0-37d4-404d-b458-935044df3ecb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.190087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.246797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7b1c0-37d4-404d-b458-935044df3ecb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.279188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f9134-483f-43ef-a170-dc8fe8aa6b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.279794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9134-483f-43ef-a170-dc8fe8aa6b7b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.280067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9134-483f-43ef-a170-dc8fe8aa6b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.280355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f9134-483f-43ef-a170-dc8fe8aa6b7b None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.281032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f9134-483f-43ef-a170-dc8fe8aa6b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:13.281330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f9134-483f-43ef-a170-dc8fe8aa6b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.282705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f9134-483f-43ef-a170-dc8fe8aa6b7b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.293477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 559/1103] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:13.299625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f8e8c-5019-44b3-a685-f705c530ef89 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.327751 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.402612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f8e8c-5019-44b3-a685-f705c530ef89 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.435547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbea2a9-7a56-4492-b374-3bf06feb8fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.436216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbea2a9-7a56-4492-b374-3bf06feb8fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.436501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbea2a9-7a56-4492-b374-3bf06feb8fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.436773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbea2a9-7a56-4492-b374-3bf06feb8fe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.443868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbea2a9-7a56-4492-b374-3bf06feb8fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.445332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbea2a9-7a56-4492-b374-3bf06feb8fe8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4dbea2a9-7a56-4492-b374-3bf06feb8fe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:13.456469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:13.457338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:13.458210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:13.458210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:13.458210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:13.458210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:13.458210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:13.458210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:13.458210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:13.458210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:13.458210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 545/1104] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:13.463509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f9134-483f-43ef-a170-dc8fe8aa6b7b None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.557333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.561474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f9134-483f-43ef-a170-dc8fe8aa6b7b None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.595201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4528367-8dde-4116-bef2-be179e28600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.595742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528367-8dde-4116-bef2-be179e28600c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.596024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528367-8dde-4116-bef2-be179e28600c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.596324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4528367-8dde-4116-bef2-be179e28600c None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.597071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528367-8dde-4116-bef2-be179e28600c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:13.597378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528367-8dde-4116-bef2-be179e28600c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.598815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4528367-8dde-4116-bef2-be179e28600c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.610978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 560/1105] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:13.617175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbea2a9-7a56-4492-b374-3bf06feb8fe8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.702939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.715021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbea2a9-7a56-4492-b374-3bf06feb8fe8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.755361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678cea3-aabe-4556-9983-9a32aa150ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.755971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cea3-aabe-4556-9983-9a32aa150ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.756299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cea3-aabe-4556-9983-9a32aa150ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.756553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678cea3-aabe-4556-9983-9a32aa150ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.757325 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678cea3-aabe-4556-9983-9a32aa150ee5 None admin] RBAC: Adding query filter params (role.id=aba8cdd000504e74bea65f7b87138d77, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=cab044fcd0dd449eafaccb81606d15ce) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:13.757629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678cea3-aabe-4556-9983-9a32aa150ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.759053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678cea3-aabe-4556-9983-9a32aa150ee5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.764909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 546/1106] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/role_assignments?user.id=cab044fcd0dd449eafaccb81606d15ce&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=aba8cdd000504e74bea65f7b87138d77 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:14.079288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0940-f731-42a0-896d-cb99f97fb96c None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.079795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0940-f731-42a0-896d-cb99f97fb96c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.079887 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b0940-f731-42a0-896d-cb99f97fb96c None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.081201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 561/1107] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:14.086354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19e1f-e9f0-45fc-a22f-960a9d8485a6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.086760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19e1f-e9f0-45fc-a22f-960a9d8485a6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.086900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c19e1f-e9f0-45fc-a22f-960a9d8485a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.105220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-97c19e1f-e9f0-45fc-a22f-960a9d8485a6 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:14.106536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-97c19e1f-e9f0-45fc-a22f-960a9d8485a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:14.176060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 547/1108] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:14.200567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0940-f731-42a0-896d-cb99f97fb96c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.308360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b0940-f731-42a0-896d-cb99f97fb96c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.342455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca7d85-5bfa-45e6-8c37-30ed67a3585c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.343115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca7d85-5bfa-45e6-8c37-30ed67a3585c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.343403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca7d85-5bfa-45e6-8c37-30ed67a3585c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.343673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca7d85-5bfa-45e6-8c37-30ed67a3585c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.345396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca7d85-5bfa-45e6-8c37-30ed67a3585c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.346820 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca7d85-5bfa-45e6-8c37-30ed67a3585c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.348440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 562/1109] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:14.354404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19e1f-e9f0-45fc-a22f-960a9d8485a6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.440654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:14.459839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c19e1f-e9f0-45fc-a22f-960a9d8485a6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.494539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79577462-cafe-4da1-9de2-109486af18d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.495158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79577462-cafe-4da1-9de2-109486af18d8 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.495435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79577462-cafe-4da1-9de2-109486af18d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.495726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79577462-cafe-4da1-9de2-109486af18d8 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.496465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79577462-cafe-4da1-9de2-109486af18d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.497874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79577462-cafe-4da1-9de2-109486af18d8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.519366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 548/1110] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:28:14 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:28:16.560822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d2f0e-7df8-4e10-8fd1-af1dc986c525 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.561372 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d2f0e-7df8-4e10-8fd1-af1dc986c525 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.561372 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d2f0e-7df8-4e10-8fd1-af1dc986c525 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.562708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 563/1111] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:16.567871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d43de-8437-4b5a-b792-bf183d30955d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.568319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d43de-8437-4b5a-b792-bf183d30955d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.568456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d43de-8437-4b5a-b792-bf183d30955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.586568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ba1d43de-8437-4b5a-b792-bf183d30955d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:16.587742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ba1d43de-8437-4b5a-b792-bf183d30955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:16.652209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 549/1112] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:16.675095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d2f0e-7df8-4e10-8fd1-af1dc986c525 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.701738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:16.775715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d2f0e-7df8-4e10-8fd1-af1dc986c525 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.808393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc027576-e3ac-4ea0-a6ed-846f3c30e696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.809027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc027576-e3ac-4ea0-a6ed-846f3c30e696 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.809308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc027576-e3ac-4ea0-a6ed-846f3c30e696 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.809582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc027576-e3ac-4ea0-a6ed-846f3c30e696 None admin] PATH_INFO: `/v3/roles/67ac8da7e16f46b496e98633276e6909` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.811053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc027576-e3ac-4ea0-a6ed-846f3c30e696 None admin] RBAC: Authorizing `identity:get_role(role_id=67ac8da7e16f46b496e98633276e6909)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.812393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc027576-e3ac-4ea0-a6ed-846f3c30e696 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.814222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 564/1113] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/roles/67ac8da7e16f46b496e98633276e6909 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:16.820015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d43de-8437-4b5a-b792-bf183d30955d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.884490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:16.917392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d43de-8437-4b5a-b792-bf183d30955d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.949783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b70fc-5598-4dfd-a504-6b1169756df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.950409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b70fc-5598-4dfd-a504-6b1169756df5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.950697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b70fc-5598-4dfd-a504-6b1169756df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.950971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b70fc-5598-4dfd-a504-6b1169756df5 None admin] PATH_INFO: `/v3/users/89c941beb5cf4c7da1ff5f8a20b6a0d8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.964032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b70fc-5598-4dfd-a504-6b1169756df5 None admin] RBAC: Authorizing `identity:get_user(user_id=89c941beb5cf4c7da1ff5f8a20b6a0d8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.965479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b70fc-5598-4dfd-a504-6b1169756df5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.967162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 550/1114] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/users/89c941beb5cf4c7da1ff5f8a20b6a0d8 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:16.972997 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc027576-e3ac-4ea0-a6ed-846f3c30e696 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.063432 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.070576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc027576-e3ac-4ea0-a6ed-846f3c30e696 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.103243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb31ed-bbf6-49d1-baed-f10f01cb3fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.103841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb31ed-bbf6-49d1-baed-f10f01cb3fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.104118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb31ed-bbf6-49d1-baed-f10f01cb3fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.104419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb31ed-bbf6-49d1-baed-f10f01cb3fe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.169942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb31ed-bbf6-49d1-baed-f10f01cb3fe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.171528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb31ed-bbf6-49d1-baed-f10f01cb3fe1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.258947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.266123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 565/1115] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:28:17.272083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b70fc-5598-4dfd-a504-6b1169756df5 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.368191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b70fc-5598-4dfd-a504-6b1169756df5 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.392171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.400526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e9a15-fcba-4dd3-9891-3b2bcbce5b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.401156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e9a15-fcba-4dd3-9891-3b2bcbce5b6b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.401437 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e9a15-fcba-4dd3-9891-3b2bcbce5b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.401710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e9a15-fcba-4dd3-9891-3b2bcbce5b6b None admin] PATH_INFO: `/v3/projects/2c8351693195496dba80f67c15cef480` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.402848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e9a15-fcba-4dd3-9891-3b2bcbce5b6b None admin] RBAC: Authorizing `identity:get_project(project_id=2c8351693195496dba80f67c15cef480)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.404567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e9a15-fcba-4dd3-9891-3b2bcbce5b6b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.406678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 551/1116] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/projects/2c8351693195496dba80f67c15cef480 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:17.412735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb31ed-bbf6-49d1-baed-f10f01cb3fe1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.509208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb31ed-bbf6-49d1-baed-f10f01cb3fe1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.542054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bd998-0ec9-4c4a-abfc-bc13f59b02f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.542661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bd998-0ec9-4c4a-abfc-bc13f59b02f7 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.542945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bd998-0ec9-4c4a-abfc-bc13f59b02f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.543218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bd998-0ec9-4c4a-abfc-bc13f59b02f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.544002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bd998-0ec9-4c4a-abfc-bc13f59b02f7 None admin] RBAC: Adding query filter params (role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=2c8351693195496dba80f67c15cef480, user.id=89c941beb5cf4c7da1ff5f8a20b6a0d8) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:17.544339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bd998-0ec9-4c4a-abfc-bc13f59b02f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.545763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bd998-0ec9-4c4a-abfc-bc13f59b02f7 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.551555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 566/1117] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/role_assignments?user.id=89c941beb5cf4c7da1ff5f8a20b6a0d8&scope.project.id=2c8351693195496dba80f67c15cef480&role.id=67ac8da7e16f46b496e98633276e6909 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:19.504624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0afa8-2736-4880-a957-5a896d4bb9a1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.505140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0afa8-2736-4880-a957-5a896d4bb9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.505140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0afa8-2736-4880-a957-5a896d4bb9a1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.506521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 552/1118] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:19.511700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d98069-10c3-451b-a33b-beb7aa29e80d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.512086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d98069-10c3-451b-a33b-beb7aa29e80d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.512360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d98069-10c3-451b-a33b-beb7aa29e80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.530117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-90d98069-10c3-451b-a33b-beb7aa29e80d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:19.531301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-90d98069-10c3-451b-a33b-beb7aa29e80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:19.582739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:19.596687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 567/1119] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:19.619405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0afa8-2736-4880-a957-5a896d4bb9a1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.715253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0afa8-2736-4880-a957-5a896d4bb9a1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:19.748376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa1e1-ab45-453b-af0d-2474c0510fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.748996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa1e1-ab45-453b-af0d-2474c0510fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.749272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa1e1-ab45-453b-af0d-2474c0510fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.749539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa1e1-ab45-453b-af0d-2474c0510fa8 None admin] PATH_INFO: `/v3/roles/67ac8da7e16f46b496e98633276e6909` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.750943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fa1e1-ab45-453b-af0d-2474c0510fa8 None admin] RBAC: Authorizing `identity:get_role(role_id=67ac8da7e16f46b496e98633276e6909)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.752305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fa1e1-ab45-453b-af0d-2474c0510fa8 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.753620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 553/1120] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/roles/67ac8da7e16f46b496e98633276e6909 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:19.759222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d98069-10c3-451b-a33b-beb7aa29e80d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.853602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d98069-10c3-451b-a33b-beb7aa29e80d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:19.885945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a6f3-d847-4ef7-8f40-89f1d15b6900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.886575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a6f3-d847-4ef7-8f40-89f1d15b6900 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.886856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a6f3-d847-4ef7-8f40-89f1d15b6900 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.887130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776a6f3-d847-4ef7-8f40-89f1d15b6900 None admin] PATH_INFO: `/v3/users/89c941beb5cf4c7da1ff5f8a20b6a0d8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.888298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776a6f3-d847-4ef7-8f40-89f1d15b6900 None admin] RBAC: Authorizing `identity:get_user(user_id=89c941beb5cf4c7da1ff5f8a20b6a0d8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.889731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776a6f3-d847-4ef7-8f40-89f1d15b6900 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.891321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 568/1121] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/users/89c941beb5cf4c7da1ff5f8a20b6a0d8 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:19.897006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa1e1-ab45-453b-af0d-2474c0510fa8 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.955958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:19.993488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa1e1-ab45-453b-af0d-2474c0510fa8 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:20.025745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc9d69-fce3-437d-baee-e030d27dfbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:20.026301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9d69-fce3-437d-baee-e030d27dfbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.026577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9d69-fce3-437d-baee-e030d27dfbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.026843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9d69-fce3-437d-baee-e030d27dfbd6 None admin] PATH_INFO: `/v3/projects/2c8351693195496dba80f67c15cef480` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.028236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc9d69-fce3-437d-baee-e030d27dfbd6 None admin] RBAC: Authorizing `identity:get_project(project_id=2c8351693195496dba80f67c15cef480)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:20.029639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc9d69-fce3-437d-baee-e030d27dfbd6 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:20.031827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 554/1122] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/projects/2c8351693195496dba80f67c15cef480 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:20.037563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a6f3-d847-4ef7-8f40-89f1d15b6900 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:20.090968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:20.135422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776a6f3-d847-4ef7-8f40-89f1d15b6900 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:20.170996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585dad-bf2f-4bae-ba07-2b2446be4ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:20.171634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585dad-bf2f-4bae-ba07-2b2446be4ae0 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.171934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585dad-bf2f-4bae-ba07-2b2446be4ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.172231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585dad-bf2f-4bae-ba07-2b2446be4ae0 None admin] PATH_INFO: `/v3/projects/2c8351693195496dba80f67c15cef480/users/89c941beb5cf4c7da1ff5f8a20b6a0d8/roles/67ac8da7e16f46b496e98633276e6909` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.174367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b585dad-bf2f-4bae-ba07-2b2446be4ae0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c8351693195496dba80f67c15cef480, user_id=89c941beb5cf4c7da1ff5f8a20b6a0d8, role_id=67ac8da7e16f46b496e98633276e6909)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:20.175802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b585dad-bf2f-4bae-ba07-2b2446be4ae0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:20.187785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 569/1123] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:20 2022] PUT /identity/v3/projects/2c8351693195496dba80f67c15cef480/users/89c941beb5cf4c7da1ff5f8a20b6a0d8/roles/67ac8da7e16f46b496e98633276e6909 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:22.135895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851d60f-c669-431f-b893-a50440c4aa47 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.136438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851d60f-c669-431f-b893-a50440c4aa47 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.136438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851d60f-c669-431f-b893-a50440c4aa47 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.137747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 555/1124] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:22.143363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9503b3-3395-4578-bfa8-44603698f4ce None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.143737 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9503b3-3395-4578-bfa8-44603698f4ce None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.143918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9503b3-3395-4578-bfa8-44603698f4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.161715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4d9503b3-3395-4578-bfa8-44603698f4ce None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:22.162889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4d9503b3-3395-4578-bfa8-44603698f4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:22.227384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 570/1125] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:22.250491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851d60f-c669-431f-b893-a50440c4aa47 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:22.349995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851d60f-c669-431f-b893-a50440c4aa47 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:22.378075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:22.383977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196ffdc-a7b7-4ad4-912c-65dee1f57df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:22.384632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196ffdc-a7b7-4ad4-912c-65dee1f57df2 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.384912 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196ffdc-a7b7-4ad4-912c-65dee1f57df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.385180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196ffdc-a7b7-4ad4-912c-65dee1f57df2 None admin] PATH_INFO: `/v3/roles/67ac8da7e16f46b496e98633276e6909` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.386694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196ffdc-a7b7-4ad4-912c-65dee1f57df2 None admin] RBAC: Authorizing `identity:get_role(role_id=67ac8da7e16f46b496e98633276e6909)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:22.387987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196ffdc-a7b7-4ad4-912c-65dee1f57df2 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:22.389380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 556/1126] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:22 2022] GET /identity/v3/roles/67ac8da7e16f46b496e98633276e6909 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:22.395240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9503b3-3395-4578-bfa8-44603698f4ce None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:22.440347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:22.491313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9503b3-3395-4578-bfa8-44603698f4ce None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:22.524338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8a409-c040-4fc2-8389-b20bece6d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:22.524963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8a409-c040-4fc2-8389-b20bece6d902 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.525241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8a409-c040-4fc2-8389-b20bece6d902 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.525512 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8a409-c040-4fc2-8389-b20bece6d902 None admin] PATH_INFO: `/v3/users/89c941beb5cf4c7da1ff5f8a20b6a0d8` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.526658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8a409-c040-4fc2-8389-b20bece6d902 None admin] RBAC: Authorizing `identity:get_user(user_id=89c941beb5cf4c7da1ff5f8a20b6a0d8)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:22.528357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb8a409-c040-4fc2-8389-b20bece6d902 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:22.529924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 571/1127] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:22 2022] GET /identity/v3/users/89c941beb5cf4c7da1ff5f8a20b6a0d8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:22.535748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196ffdc-a7b7-4ad4-912c-65dee1f57df2 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:22.631694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196ffdc-a7b7-4ad4-912c-65dee1f57df2 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:22.665316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063069c9-3f43-4962-8f7c-5d45b1915899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:22.665856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063069c9-3f43-4962-8f7c-5d45b1915899 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.666138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063069c9-3f43-4962-8f7c-5d45b1915899 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.666408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063069c9-3f43-4962-8f7c-5d45b1915899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.726960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:22.730517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063069c9-3f43-4962-8f7c-5d45b1915899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:22.732108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063069c9-3f43-4962-8f7c-5d45b1915899 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:22.830826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 557/1128] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:22.836691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8a409-c040-4fc2-8389-b20bece6d902 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:22.932027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8a409-c040-4fc2-8389-b20bece6d902 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:22.945315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:22.964897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171f23-53fa-4c94-aa23-d70f4e8b0b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:22.965531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171f23-53fa-4c94-aa23-d70f4e8b0b2c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.965811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171f23-53fa-4c94-aa23-d70f4e8b0b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.966082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171f23-53fa-4c94-aa23-d70f4e8b0b2c None admin] PATH_INFO: `/v3/projects/2c8351693195496dba80f67c15cef480` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.967217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3171f23-53fa-4c94-aa23-d70f4e8b0b2c None admin] RBAC: Authorizing `identity:get_project(project_id=2c8351693195496dba80f67c15cef480)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:22.969288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3171f23-53fa-4c94-aa23-d70f4e8b0b2c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:22.970907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 572/1129] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:22 2022] GET /identity/v3/projects/2c8351693195496dba80f67c15cef480 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:22.976996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063069c9-3f43-4962-8f7c-5d45b1915899 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:23.068679 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:23.072640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063069c9-3f43-4962-8f7c-5d45b1915899 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:23.106389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637e9f5-933e-435e-94f1-8274d8c9b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:23.106984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e9f5-933e-435e-94f1-8274d8c9b976 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.107264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e9f5-933e-435e-94f1-8274d8c9b976 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.107534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637e9f5-933e-435e-94f1-8274d8c9b976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.108334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637e9f5-933e-435e-94f1-8274d8c9b976 None admin] RBAC: Adding query filter params (role.id=67ac8da7e16f46b496e98633276e6909, scope.project.id=2c8351693195496dba80f67c15cef480, user.id=89c941beb5cf4c7da1ff5f8a20b6a0d8) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:23.108641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637e9f5-933e-435e-94f1-8274d8c9b976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:23.110049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637e9f5-933e-435e-94f1-8274d8c9b976 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:23.118075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 558/1130] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:22 2022] GET /identity/v3/role_assignments?user.id=89c941beb5cf4c7da1ff5f8a20b6a0d8&scope.project.id=2c8351693195496dba80f67c15cef480&role.id=67ac8da7e16f46b496e98633276e6909 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:25.092733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034deab-9a37-4102-b56a-01fd433aa634 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.093235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034deab-9a37-4102-b56a-01fd433aa634 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.093235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9034deab-9a37-4102-b56a-01fd433aa634 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.094585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 573/1131] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:25.099856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db0d9-5242-48e0-b313-194285a15042 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.100258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db0d9-5242-48e0-b313-194285a15042 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.100454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db0d9-5242-48e0-b313-194285a15042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.122198 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b77db0d9-5242-48e0-b313-194285a15042 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:25.123384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b77db0d9-5242-48e0-b313-194285a15042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:25.191571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 559/1132] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:25.214681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034deab-9a37-4102-b56a-01fd433aa634 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.313098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9034deab-9a37-4102-b56a-01fd433aa634 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.345016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5422d3-55a4-4347-9453-80993a4d792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.345579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5422d3-55a4-4347-9453-80993a4d792b None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.345859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5422d3-55a4-4347-9453-80993a4d792b None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.346131 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5422d3-55a4-4347-9453-80993a4d792b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.347267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5422d3-55a4-4347-9453-80993a4d792b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.348733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5422d3-55a4-4347-9453-80993a4d792b None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.350287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 574/1133] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:25.356308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77db0d9-5242-48e0-b313-194285a15042 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.446096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:25.455009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77db0d9-5242-48e0-b313-194285a15042 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.489184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72004c79-4a6a-4bf5-9431-21d563ee6299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.489794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72004c79-4a6a-4bf5-9431-21d563ee6299 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.490074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72004c79-4a6a-4bf5-9431-21d563ee6299 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.490347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72004c79-4a6a-4bf5-9431-21d563ee6299 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.491021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72004c79-4a6a-4bf5-9431-21d563ee6299 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.492468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72004c79-4a6a-4bf5-9431-21d563ee6299 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.518784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 560/1134] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:25 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:27.541578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f76a6-2b4a-4a5f-a2ff-d38b533b2d3c None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.542128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f76a6-2b4a-4a5f-a2ff-d38b533b2d3c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.542128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f76a6-2b4a-4a5f-a2ff-d38b533b2d3c None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.543456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 575/1135] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:27.548823 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3953f-6776-4229-a63d-5c1f7305a728 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.549241 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3953f-6776-4229-a63d-5c1f7305a728 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.549371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3953f-6776-4229-a63d-5c1f7305a728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.567028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-efd3953f-6776-4229-a63d-5c1f7305a728 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:27.568236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-efd3953f-6776-4229-a63d-5c1f7305a728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:27.632203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 561/1136] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:27.657296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f76a6-2b4a-4a5f-a2ff-d38b533b2d3c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:27.707356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:27.757007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f76a6-2b4a-4a5f-a2ff-d38b533b2d3c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:27.790195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5fe5a-b7f0-496f-9d5a-dc8337e231f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.791078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5fe5a-b7f0-496f-9d5a-dc8337e231f4 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.791364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5fe5a-b7f0-496f-9d5a-dc8337e231f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.791688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5fe5a-b7f0-496f-9d5a-dc8337e231f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.792801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5fe5a-b7f0-496f-9d5a-dc8337e231f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.794225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5fe5a-b7f0-496f-9d5a-dc8337e231f4 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.795798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 576/1137] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:27.801796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3953f-6776-4229-a63d-5c1f7305a728 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:27.875659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:27.901685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3953f-6776-4229-a63d-5c1f7305a728 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:27.934109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85ed37-d5ca-44af-8fb2-0e4a5957e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.934719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85ed37-d5ca-44af-8fb2-0e4a5957e3f4 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.935002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85ed37-d5ca-44af-8fb2-0e4a5957e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.935272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85ed37-d5ca-44af-8fb2-0e4a5957e3f4 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.935958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85ed37-d5ca-44af-8fb2-0e4a5957e3f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.937936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e85ed37-d5ca-44af-8fb2-0e4a5957e3f4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.959121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 562/1138] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:28:27 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:29.975100 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44098-097b-46ed-abbf-297164203438 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.975630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44098-097b-46ed-abbf-297164203438 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.975630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce44098-097b-46ed-abbf-297164203438 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.977005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 577/1139] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:29.982176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70565-a463-4703-9594-c1cf0a3d1a34 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.982589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70565-a463-4703-9594-c1cf0a3d1a34 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.982728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70565-a463-4703-9594-c1cf0a3d1a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.001460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7da70565-a463-4703-9594-c1cf0a3d1a34 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:30.002643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7da70565-a463-4703-9594-c1cf0a3d1a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:30.066729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 563/1140] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:30.089200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce44098-097b-46ed-abbf-297164203438 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.199075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce44098-097b-46ed-abbf-297164203438 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.215540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.232337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fd760-9777-48d3-8a7c-22be96ca7540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.232965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fd760-9777-48d3-8a7c-22be96ca7540 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.233241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fd760-9777-48d3-8a7c-22be96ca7540 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.233573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fd760-9777-48d3-8a7c-22be96ca7540 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.243709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9fd760-9777-48d3-8a7c-22be96ca7540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-dd9fd760-9777-48d3-8a7c-22be96ca7540 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:30.248541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:30.249790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:30.250862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 578/1141] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:30.255775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da70565-a463-4703-9594-c1cf0a3d1a34 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.312665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.352408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da70565-a463-4703-9594-c1cf0a3d1a34 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.385014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db88d-663c-4de7-8ef0-11680fcfe670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.385620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db88d-663c-4de7-8ef0-11680fcfe670 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.385900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db88d-663c-4de7-8ef0-11680fcfe670 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.386174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db88d-663c-4de7-8ef0-11680fcfe670 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.386884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03db88d-663c-4de7-8ef0-11680fcfe670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:30.387189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03db88d-663c-4de7-8ef0-11680fcfe670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.388579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03db88d-663c-4de7-8ef0-11680fcfe670 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.396337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 564/1142] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:30.401995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fd760-9777-48d3-8a7c-22be96ca7540 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.500731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fd760-9777-48d3-8a7c-22be96ca7540 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.534592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44954-54cf-4ee4-900a-6d9c7d2dfdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.535215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44954-54cf-4ee4-900a-6d9c7d2dfdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.535494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44954-54cf-4ee4-900a-6d9c7d2dfdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.535765 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44954-54cf-4ee4-900a-6d9c7d2dfdd8 None admin] PATH_INFO: `/v3/users/0d3c2b3998bd483d98d0e76affd605f9` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.551553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a44954-54cf-4ee4-900a-6d9c7d2dfdd8 None admin] RBAC: Authorizing `identity:get_user(user_id=0d3c2b3998bd483d98d0e76affd605f9)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.553023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a44954-54cf-4ee4-900a-6d9c7d2dfdd8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.554617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 579/1143] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/users/0d3c2b3998bd483d98d0e76affd605f9 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:30.560557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db88d-663c-4de7-8ef0-11680fcfe670 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.657646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db88d-663c-4de7-8ef0-11680fcfe670 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.678496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.690184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da386-3875-47ad-bbc4-e098d3e1fd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.690791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da386-3875-47ad-bbc4-e098d3e1fd87 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.691073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da386-3875-47ad-bbc4-e098d3e1fd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.691345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04da386-3875-47ad-bbc4-e098d3e1fd87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.755443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04da386-3875-47ad-bbc4-e098d3e1fd87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.756899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04da386-3875-47ad-bbc4-e098d3e1fd87 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.859093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 565/1144] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:30.865128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44954-54cf-4ee4-900a-6d9c7d2dfdd8 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.898156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.961476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44954-54cf-4ee4-900a-6d9c7d2dfdd8 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.993180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698dce8-b934-46b7-ba6c-7590bda6c942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.993802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698dce8-b934-46b7-ba6c-7590bda6c942 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.994082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698dce8-b934-46b7-ba6c-7590bda6c942 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.994354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698dce8-b934-46b7-ba6c-7590bda6c942 None admin] PATH_INFO: `/v3/projects/5f5d256f0fc04aec9a99316105ec467a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.995491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698dce8-b934-46b7-ba6c-7590bda6c942 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5d256f0fc04aec9a99316105ec467a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.996934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698dce8-b934-46b7-ba6c-7590bda6c942 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.998544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 580/1145] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/projects/5f5d256f0fc04aec9a99316105ec467a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:31.005214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da386-3875-47ad-bbc4-e098d3e1fd87 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.028856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:31.101434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04da386-3875-47ad-bbc4-e098d3e1fd87 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.134761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49017e4a-ba2d-4961-a4cf-53425afece07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.135364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017e4a-ba2d-4961-a4cf-53425afece07 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.135645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017e4a-ba2d-4961-a4cf-53425afece07 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.135917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49017e4a-ba2d-4961-a4cf-53425afece07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.136726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49017e4a-ba2d-4961-a4cf-53425afece07 None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=5f5d256f0fc04aec9a99316105ec467a, user.id=0d3c2b3998bd483d98d0e76affd605f9) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:31.137039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49017e4a-ba2d-4961-a4cf-53425afece07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:31.138447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49017e4a-ba2d-4961-a4cf-53425afece07 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:31.145925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 566/1146] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:31 2022] GET /identity/v3/role_assignments?user.id=0d3c2b3998bd483d98d0e76affd605f9&scope.project.id=5f5d256f0fc04aec9a99316105ec467a&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:33.103996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5de13-ba71-460a-a858-c60d16a23042 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.104543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5de13-ba71-460a-a858-c60d16a23042 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.104543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5de13-ba71-460a-a858-c60d16a23042 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.105837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 581/1147] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:33.111571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd1ac-2e4f-489d-adb7-eefd1a9b9d8e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.112010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd1ac-2e4f-489d-adb7-eefd1a9b9d8e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.112115 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddd1ac-2e4f-489d-adb7-eefd1a9b9d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.129628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a5ddd1ac-2e4f-489d-adb7-eefd1a9b9d8e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:33.130791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a5ddd1ac-2e4f-489d-adb7-eefd1a9b9d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:33.209988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 567/1148] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:33.232030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5de13-ba71-460a-a858-c60d16a23042 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.330080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5de13-ba71-460a-a858-c60d16a23042 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.332371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.364263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff748-5890-4eda-9ac0-1debe3794cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.364829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff748-5890-4eda-9ac0-1debe3794cce None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.365108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff748-5890-4eda-9ac0-1debe3794cce None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.365379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ff748-5890-4eda-9ac0-1debe3794cce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.375581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ff748-5890-4eda-9ac0-1debe3794cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-456ff748-5890-4eda-9ac0-1debe3794cce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:33.380479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:33.381693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:33.382763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 582/1149] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:33.387845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd1ac-2e4f-489d-adb7-eefd1a9b9d8e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.405038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.507781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddd1ac-2e4f-489d-adb7-eefd1a9b9d8e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.545691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a24c36-738f-44df-91cc-d3879924c1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.546310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a24c36-738f-44df-91cc-d3879924c1cc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.546591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a24c36-738f-44df-91cc-d3879924c1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.546862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a24c36-738f-44df-91cc-d3879924c1cc None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.547575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a24c36-738f-44df-91cc-d3879924c1cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:33.547880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a24c36-738f-44df-91cc-d3879924c1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.549267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a24c36-738f-44df-91cc-d3879924c1cc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.560194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 568/1150] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:33.566074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff748-5890-4eda-9ac0-1debe3794cce None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.668273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ff748-5890-4eda-9ac0-1debe3794cce None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.701162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324fad-cf5b-4fba-90d4-75b90fc91f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.701785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324fad-cf5b-4fba-90d4-75b90fc91f8c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.702599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324fad-cf5b-4fba-90d4-75b90fc91f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.702885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21324fad-cf5b-4fba-90d4-75b90fc91f8c None admin] PATH_INFO: `/v3/users/0d3c2b3998bd483d98d0e76affd605f9` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.704048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21324fad-cf5b-4fba-90d4-75b90fc91f8c None admin] RBAC: Authorizing `identity:get_user(user_id=0d3c2b3998bd483d98d0e76affd605f9)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.705505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21324fad-cf5b-4fba-90d4-75b90fc91f8c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.707085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 583/1151] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/users/0d3c2b3998bd483d98d0e76affd605f9 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:33.712913 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a24c36-738f-44df-91cc-d3879924c1cc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.795676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.818562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a24c36-738f-44df-91cc-d3879924c1cc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.852541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3052ad-8db1-4a31-babf-848e4f648d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.853169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3052ad-8db1-4a31-babf-848e4f648d54 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.853447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3052ad-8db1-4a31-babf-848e4f648d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.853719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3052ad-8db1-4a31-babf-848e4f648d54 None admin] PATH_INFO: `/v3/projects/5f5d256f0fc04aec9a99316105ec467a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.854857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3052ad-8db1-4a31-babf-848e4f648d54 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5d256f0fc04aec9a99316105ec467a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.856300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3052ad-8db1-4a31-babf-848e4f648d54 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.857959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 569/1152] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/projects/5f5d256f0fc04aec9a99316105ec467a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:33.863974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324fad-cf5b-4fba-90d4-75b90fc91f8c None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.895505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.963688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21324fad-cf5b-4fba-90d4-75b90fc91f8c None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.996291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d881fa-bb42-417d-b496-f5ff9a5686f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.996945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d881fa-bb42-417d-b496-f5ff9a5686f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.997221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d881fa-bb42-417d-b496-f5ff9a5686f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.997492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d881fa-bb42-417d-b496-f5ff9a5686f5 None admin] PATH_INFO: `/v3/projects/5f5d256f0fc04aec9a99316105ec467a/users/0d3c2b3998bd483d98d0e76affd605f9/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.999996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d881fa-bb42-417d-b496-f5ff9a5686f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f5d256f0fc04aec9a99316105ec467a, user_id=0d3c2b3998bd483d98d0e76affd605f9, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:34.001469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d881fa-bb42-417d-b496-f5ff9a5686f5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:34.015164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 584/1153] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:33 2022] PUT /identity/v3/projects/5f5d256f0fc04aec9a99316105ec467a/users/0d3c2b3998bd483d98d0e76affd605f9/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:35.975945 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6ecfb-2ef4-4c8a-a3a9-5d72d94e2371 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.976504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6ecfb-2ef4-4c8a-a3a9-5d72d94e2371 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.976504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a6ecfb-2ef4-4c8a-a3a9-5d72d94e2371 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.977876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 570/1154] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:35.983008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f3adf-aef8-4247-8cd7-0de853154d32 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.983368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f3adf-aef8-4247-8cd7-0de853154d32 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.983593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f3adf-aef8-4247-8cd7-0de853154d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.001728 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-124f3adf-aef8-4247-8cd7-0de853154d32 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:36.002898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-124f3adf-aef8-4247-8cd7-0de853154d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:36.066620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 585/1155] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:36.089549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6ecfb-2ef4-4c8a-a3a9-5d72d94e2371 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.188834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a6ecfb-2ef4-4c8a-a3a9-5d72d94e2371 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.220936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0064a-76e3-4658-a374-a2afb855287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.221553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0064a-76e3-4658-a374-a2afb855287e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.221841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0064a-76e3-4658-a374-a2afb855287e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.222114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0064a-76e3-4658-a374-a2afb855287e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.232421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db0064a-76e3-4658-a374-a2afb855287e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3db0064a-76e3-4658-a374-a2afb855287e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:36.237357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:36.238444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:36.239461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 571/1156] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:36.244447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f3adf-aef8-4247-8cd7-0de853154d32 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.267966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.340534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f3adf-aef8-4247-8cd7-0de853154d32 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.371979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70965dca-c44d-4a25-8c79-3ec0e188965f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.372612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70965dca-c44d-4a25-8c79-3ec0e188965f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.372895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70965dca-c44d-4a25-8c79-3ec0e188965f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.373167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70965dca-c44d-4a25-8c79-3ec0e188965f None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.374372 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70965dca-c44d-4a25-8c79-3ec0e188965f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:36.374675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70965dca-c44d-4a25-8c79-3ec0e188965f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:36.376026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70965dca-c44d-4a25-8c79-3ec0e188965f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:36.383698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 586/1157] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:36.389353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0064a-76e3-4658-a374-a2afb855287e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.398783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.487253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0064a-76e3-4658-a374-a2afb855287e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.519971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf62771-8bac-436c-ab88-2e277545c442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.520624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf62771-8bac-436c-ab88-2e277545c442 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.520906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf62771-8bac-436c-ab88-2e277545c442 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.521178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf62771-8bac-436c-ab88-2e277545c442 None admin] PATH_INFO: `/v3/users/0d3c2b3998bd483d98d0e76affd605f9` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.522324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf62771-8bac-436c-ab88-2e277545c442 None admin] RBAC: Authorizing `identity:get_user(user_id=0d3c2b3998bd483d98d0e76affd605f9)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:36.523768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf62771-8bac-436c-ab88-2e277545c442 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:36.525389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 572/1158] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/users/0d3c2b3998bd483d98d0e76affd605f9 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:36.531419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70965dca-c44d-4a25-8c79-3ec0e188965f None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.613030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.629334 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70965dca-c44d-4a25-8c79-3ec0e188965f None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.661530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712581b-2927-4ba3-b42c-a681f3ecbbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.662130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712581b-2927-4ba3-b42c-a681f3ecbbca None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.662415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712581b-2927-4ba3-b42c-a681f3ecbbca None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.662688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712581b-2927-4ba3-b42c-a681f3ecbbca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.726844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712581b-2927-4ba3-b42c-a681f3ecbbca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:36.728310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712581b-2927-4ba3-b42c-a681f3ecbbca None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:36.814324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.831156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 587/1159] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:36.837065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf62771-8bac-436c-ab88-2e277545c442 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.910471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.934571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf62771-8bac-436c-ab88-2e277545c442 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.965851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7203f-fa44-479c-a9eb-f4b9f96d87c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.966470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7203f-fa44-479c-a9eb-f4b9f96d87c0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.966748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7203f-fa44-479c-a9eb-f4b9f96d87c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.967020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7203f-fa44-479c-a9eb-f4b9f96d87c0 None admin] PATH_INFO: `/v3/projects/5f5d256f0fc04aec9a99316105ec467a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.968688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7203f-fa44-479c-a9eb-f4b9f96d87c0 None admin] RBAC: Authorizing `identity:get_project(project_id=5f5d256f0fc04aec9a99316105ec467a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:36.970096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7203f-fa44-479c-a9eb-f4b9f96d87c0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:36.971721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 573/1160] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/projects/5f5d256f0fc04aec9a99316105ec467a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:36.977825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712581b-2927-4ba3-b42c-a681f3ecbbca None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:37.073022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712581b-2927-4ba3-b42c-a681f3ecbbca None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:37.105360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0064dd4d-448c-43c8-8abd-a86cd7652cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:37.105959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064dd4d-448c-43c8-8abd-a86cd7652cbe None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:37.106242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064dd4d-448c-43c8-8abd-a86cd7652cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:37.106518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0064dd4d-448c-43c8-8abd-a86cd7652cbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:37.107298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064dd4d-448c-43c8-8abd-a86cd7652cbe None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=5f5d256f0fc04aec9a99316105ec467a, user.id=0d3c2b3998bd483d98d0e76affd605f9) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:37.107609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064dd4d-448c-43c8-8abd-a86cd7652cbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:37.109653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0064dd4d-448c-43c8-8abd-a86cd7652cbe None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:37.115168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 588/1161] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/role_assignments?user.id=0d3c2b3998bd483d98d0e76affd605f9&scope.project.id=5f5d256f0fc04aec9a99316105ec467a&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:39.112253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce2b14-3781-4644-b88b-79e110bfc202 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.112745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce2b14-3781-4644-b88b-79e110bfc202 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.112745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce2b14-3781-4644-b88b-79e110bfc202 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.114059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 574/1162] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:39.119133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c44cb2-8397-463f-97c7-80e95a74bc4f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.119544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c44cb2-8397-463f-97c7-80e95a74bc4f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.119673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c44cb2-8397-463f-97c7-80e95a74bc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.137636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-00c44cb2-8397-463f-97c7-80e95a74bc4f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:39.138799 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-00c44cb2-8397-463f-97c7-80e95a74bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:39.181219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:39.205734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 589/1163] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:39.227240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce2b14-3781-4644-b88b-79e110bfc202 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:39.325337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce2b14-3781-4644-b88b-79e110bfc202 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.357452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a186d-e5fa-4396-a495-b39f4842faba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.358051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a186d-e5fa-4396-a495-b39f4842faba None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.358330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a186d-e5fa-4396-a495-b39f4842faba None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.358601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a186d-e5fa-4396-a495-b39f4842faba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.369826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:39.423734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a186d-e5fa-4396-a495-b39f4842faba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.425192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a186d-e5fa-4396-a495-b39f4842faba None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.518796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 575/1164] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:39.524980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c44cb2-8397-463f-97c7-80e95a74bc4f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:39.617736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c44cb2-8397-463f-97c7-80e95a74bc4f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.649649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610288cf-7e62-4ce1-942e-eca59d920409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.650212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610288cf-7e62-4ce1-942e-eca59d920409 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.650487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610288cf-7e62-4ce1-942e-eca59d920409 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.650748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610288cf-7e62-4ce1-942e-eca59d920409 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.657373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610288cf-7e62-4ce1-942e-eca59d920409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.658800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610288cf-7e62-4ce1-942e-eca59d920409 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-610288cf-7e62-4ce1-942e-eca59d920409 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:39.669756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:39.671410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:39.672309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 590/1165] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:28:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:39.677375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a186d-e5fa-4396-a495-b39f4842faba None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:39.718696 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:39.773327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a186d-e5fa-4396-a495-b39f4842faba None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.806282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca3606-cad0-484e-86f0-e29347f176bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.806888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3606-cad0-484e-86f0-e29347f176bc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.807164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3606-cad0-484e-86f0-e29347f176bc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.807430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca3606-cad0-484e-86f0-e29347f176bc None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.808104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca3606-cad0-484e-86f0-e29347f176bc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:39.808428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca3606-cad0-484e-86f0-e29347f176bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.809764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca3606-cad0-484e-86f0-e29347f176bc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.817377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 576/1166] 10.222.0.57 () {56 vars in 1115 bytes} [Tue Aug 2 21:28:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:41.790026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66920645-adfa-48c8-8c32-1016cefb3e5e None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.790607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66920645-adfa-48c8-8c32-1016cefb3e5e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.790607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66920645-adfa-48c8-8c32-1016cefb3e5e None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.791900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 591/1167] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:41.797352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50362c-dbd2-44b2-a2d6-c06e9f22edee None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.797775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50362c-dbd2-44b2-a2d6-c06e9f22edee None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.798023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50362c-dbd2-44b2-a2d6-c06e9f22edee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.815688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7e50362c-dbd2-44b2-a2d6-c06e9f22edee None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:41.816887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7e50362c-dbd2-44b2-a2d6-c06e9f22edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:41.880001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 577/1168] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:41.902986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66920645-adfa-48c8-8c32-1016cefb3e5e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:41.942911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:42.003213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66920645-adfa-48c8-8c32-1016cefb3e5e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.042251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6dfe1-889a-47b5-aab1-4a7d1390500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.042787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6dfe1-889a-47b5-aab1-4a7d1390500c None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.043068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6dfe1-889a-47b5-aab1-4a7d1390500c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.043338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6dfe1-889a-47b5-aab1-4a7d1390500c None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.044044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6dfe1-889a-47b5-aab1-4a7d1390500c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.045466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6dfe1-889a-47b5-aab1-4a7d1390500c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.060404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 592/1169] 10.222.0.57 () {60 vars in 1138 bytes} [Tue Aug 2 21:28:41 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:28:44.052794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ce01-9e17-4fbc-b962-3fdc2f0ab366 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.053289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ce01-9e17-4fbc-b962-3fdc2f0ab366 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.053289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ce01-9e17-4fbc-b962-3fdc2f0ab366 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.054604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 578/1170] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:44.059818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f96fb8-dacf-457b-b57f-d7e6d39d5479 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.060260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f96fb8-dacf-457b-b57f-d7e6d39d5479 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.060403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f96fb8-dacf-457b-b57f-d7e6d39d5479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.078560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a1f96fb8-dacf-457b-b57f-d7e6d39d5479 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:44.079777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a1f96fb8-dacf-457b-b57f-d7e6d39d5479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:44.157024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 593/1171] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:44.179823 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72ce01-9e17-4fbc-b962-3fdc2f0ab366 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:44.214860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:44.278460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72ce01-9e17-4fbc-b962-3fdc2f0ab366 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:44.312405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0011543-3be6-47c5-8549-5d6268fca4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:44.312963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0011543-3be6-47c5-8549-5d6268fca4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.313238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0011543-3be6-47c5-8549-5d6268fca4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.313505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0011543-3be6-47c5-8549-5d6268fca4d5 None admin] PATH_INFO: `/v3/domains/f2ed8c68ed8f4017935e349decc07401` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.323350 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0011543-3be6-47c5-8549-5d6268fca4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f2ed8c68ed8f4017935e349decc07401)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:44.324793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0011543-3be6-47c5-8549-5d6268fca4d5 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:44.326582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 579/1172] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Aug 2 21:28:44 2022] GET /identity/v3/domains/f2ed8c68ed8f4017935e349decc07401 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:44.332221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f96fb8-dacf-457b-b57f-d7e6d39d5479 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:44.359819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:44.427888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f96fb8-dacf-457b-b57f-d7e6d39d5479 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:44.461304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6144e-4267-4152-86e2-b9e8652a4555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:44.461920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6144e-4267-4152-86e2-b9e8652a4555 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.462196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6144e-4267-4152-86e2-b9e8652a4555 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.462463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6144e-4267-4152-86e2-b9e8652a4555 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.463144 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6144e-4267-4152-86e2-b9e8652a4555 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:44.464606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e6144e-4267-4152-86e2-b9e8652a4555 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:44.491345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 594/1173] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:44 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:46.507761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe911a-6a43-40a4-98bf-8e015dabdd4f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.508308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe911a-6a43-40a4-98bf-8e015dabdd4f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.508400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe911a-6a43-40a4-98bf-8e015dabdd4f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.509687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 580/1174] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:46.515389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bcc9-a200-42fd-9df9-0234c00e8dfc None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.515788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bcc9-a200-42fd-9df9-0234c00e8dfc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.515950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8bcc9-a200-42fd-9df9-0234c00e8dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.534832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-83c8bcc9-a200-42fd-9df9-0234c00e8dfc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:46.536015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-83c8bcc9-a200-42fd-9df9-0234c00e8dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:46.600939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 595/1175] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:46.625003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe911a-6a43-40a4-98bf-8e015dabdd4f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.718281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:46.724987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe911a-6a43-40a4-98bf-8e015dabdd4f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:46.757125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea46efa-bcf9-4203-b9c8-8d527115986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:46.757750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46efa-bcf9-4203-b9c8-8d527115986e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.758077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46efa-bcf9-4203-b9c8-8d527115986e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.758302 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea46efa-bcf9-4203-b9c8-8d527115986e None admin] PATH_INFO: `/v3/domains/f2ed8c68ed8f4017935e349decc07401` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.759440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea46efa-bcf9-4203-b9c8-8d527115986e None admin] RBAC: Authorizing `identity:get_domain(domain_id=f2ed8c68ed8f4017935e349decc07401)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:46.760882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea46efa-bcf9-4203-b9c8-8d527115986e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:46.762459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 581/1176] 10.222.0.57 () {56 vars in 1183 bytes} [Tue Aug 2 21:28:46 2022] GET /identity/v3/domains/f2ed8c68ed8f4017935e349decc07401 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:46.769027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8bcc9-a200-42fd-9df9-0234c00e8dfc None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.780823 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:46.866350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8bcc9-a200-42fd-9df9-0234c00e8dfc None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:46.899648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1bc15b-3bf3-4745-a8ee-7f54bfda58b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:46.900288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bc15b-3bf3-4745-a8ee-7f54bfda58b0 None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.900580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bc15b-3bf3-4745-a8ee-7f54bfda58b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.900853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1bc15b-3bf3-4745-a8ee-7f54bfda58b0 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.901550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bc15b-3bf3-4745-a8ee-7f54bfda58b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:46.903246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1bc15b-3bf3-4745-a8ee-7f54bfda58b0 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:46.923358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 596/1177] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:28:46 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:48.947031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239f9c-b22c-467b-952c-e1ccf0b0dbd8 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.947540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239f9c-b22c-467b-952c-e1ccf0b0dbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.947631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76239f9c-b22c-467b-952c-e1ccf0b0dbd8 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.948957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 582/1178] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:48.954683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebb12-25a9-4e58-a9e6-fab52ea247e8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.955098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebb12-25a9-4e58-a9e6-fab52ea247e8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.955232 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebb12-25a9-4e58-a9e6-fab52ea247e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.972832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-026ebb12-25a9-4e58-a9e6-fab52ea247e8 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:48.974019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-026ebb12-25a9-4e58-a9e6-fab52ea247e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:49.031631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:49.039598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 597/1179] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:49.062246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76239f9c-b22c-467b-952c-e1ccf0b0dbd8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:49.160664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76239f9c-b22c-467b-952c-e1ccf0b0dbd8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:49.192313 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea80b48-fb56-4bf5-bf4d-f0abe2edfb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:49.192930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea80b48-fb56-4bf5-bf4d-f0abe2edfb5d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:49.193207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea80b48-fb56-4bf5-bf4d-f0abe2edfb5d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:49.193482 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea80b48-fb56-4bf5-bf4d-f0abe2edfb5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:49.204179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea80b48-fb56-4bf5-bf4d-f0abe2edfb5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-3ea80b48-fb56-4bf5-bf4d-f0abe2edfb5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:49.209035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:49.210102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:49.210982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 583/1180] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:49.216310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ebb12-25a9-4e58-a9e6-fab52ea247e8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:49.316059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ebb12-25a9-4e58-a9e6-fab52ea247e8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:49.348100 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc99d-77da-4f54-b49c-890baea149a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:49.348732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc99d-77da-4f54-b49c-890baea149a1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:49.349008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc99d-77da-4f54-b49c-890baea149a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:49.349270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37bc99d-77da-4f54-b49c-890baea149a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:49.349970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bc99d-77da-4f54-b49c-890baea149a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:49.350267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bc99d-77da-4f54-b49c-890baea149a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:49.351626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37bc99d-77da-4f54-b49c-890baea149a1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:49.359708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 598/1181] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:49.365729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea80b48-fb56-4bf5-bf4d-f0abe2edfb5d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:49.391016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:49.462441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea80b48-fb56-4bf5-bf4d-f0abe2edfb5d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:49.494926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5ec8e-ed42-4367-aed0-862e63738cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:49.495563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5ec8e-ed42-4367-aed0-862e63738cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:49.495845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5ec8e-ed42-4367-aed0-862e63738cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:49.496122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df5ec8e-ed42-4367-aed0-862e63738cb3 None admin] PATH_INFO: `/v3/users/e4301f2645ce47a4aada37d4c7ad915f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:49.509377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5ec8e-ed42-4367-aed0-862e63738cb3 None admin] RBAC: Authorizing `identity:get_user(user_id=e4301f2645ce47a4aada37d4c7ad915f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:49.510797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df5ec8e-ed42-4367-aed0-862e63738cb3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:49.512463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 584/1182] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:49 2022] GET /identity/v3/users/e4301f2645ce47a4aada37d4c7ad915f => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:49.518159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc99d-77da-4f54-b49c-890baea149a1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:49.574619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:49.615494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37bc99d-77da-4f54-b49c-890baea149a1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:49.646754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73781d-d3b4-4b73-9645-eb1dc97727c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:49.647355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73781d-d3b4-4b73-9645-eb1dc97727c1 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:49.647633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73781d-d3b4-4b73-9645-eb1dc97727c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:49.647902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73781d-d3b4-4b73-9645-eb1dc97727c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:49.712936 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73781d-d3b4-4b73-9645-eb1dc97727c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:49.714381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73781d-d3b4-4b73-9645-eb1dc97727c1 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:49.768509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:49.809891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 599/1183] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:49.815702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5ec8e-ed42-4367-aed0-862e63738cb3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:49.892295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:49.910266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df5ec8e-ed42-4367-aed0-862e63738cb3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:49.942354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da255f-1f2d-47a9-8587-e8496dfb0060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:49.942969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da255f-1f2d-47a9-8587-e8496dfb0060 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:49.943246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da255f-1f2d-47a9-8587-e8496dfb0060 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:49.943515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da255f-1f2d-47a9-8587-e8496dfb0060 None admin] PATH_INFO: `/v3/projects/5db3aced0cb34df293f1b049d709a300` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:49.944657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da255f-1f2d-47a9-8587-e8496dfb0060 None admin] RBAC: Authorizing `identity:get_project(project_id=5db3aced0cb34df293f1b049d709a300)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:49.946074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da255f-1f2d-47a9-8587-e8496dfb0060 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:49.947688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 585/1184] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:49 2022] GET /identity/v3/projects/5db3aced0cb34df293f1b049d709a300 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:49.953673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73781d-d3b4-4b73-9645-eb1dc97727c1 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:50.049624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73781d-d3b4-4b73-9645-eb1dc97727c1 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:50.082248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a93297-40ba-4ec4-8cab-2a5d35e83d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:50.082846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a93297-40ba-4ec4-8cab-2a5d35e83d20 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:50.083125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a93297-40ba-4ec4-8cab-2a5d35e83d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:50.083397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a93297-40ba-4ec4-8cab-2a5d35e83d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:50.084191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a93297-40ba-4ec4-8cab-2a5d35e83d20 None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=5db3aced0cb34df293f1b049d709a300, user.id=e4301f2645ce47a4aada37d4c7ad915f) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:50.084500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a93297-40ba-4ec4-8cab-2a5d35e83d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:50.085910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a93297-40ba-4ec4-8cab-2a5d35e83d20 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:50.091089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 600/1185] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:49 2022] GET /identity/v3/role_assignments?user.id=e4301f2645ce47a4aada37d4c7ad915f&scope.project.id=5db3aced0cb34df293f1b049d709a300&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:52.073245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401b550-c9f3-4974-bcc7-342d4d078fb9 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.073778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401b550-c9f3-4974-bcc7-342d4d078fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.073778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401b550-c9f3-4974-bcc7-342d4d078fb9 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.075076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 586/1186] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:52.080902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ad44-6a5c-445c-8dc1-3f04301f6ee4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.081292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ad44-6a5c-445c-8dc1-3f04301f6ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.081476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793ad44-6a5c-445c-8dc1-3f04301f6ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.098976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7793ad44-6a5c-445c-8dc1-3f04301f6ee4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:52.100174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7793ad44-6a5c-445c-8dc1-3f04301f6ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:52.115880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:52.168693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 601/1187] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:52.191538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401b550-c9f3-4974-bcc7-342d4d078fb9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.289181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401b550-c9f3-4974-bcc7-342d4d078fb9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.322439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17534688-e7be-4f48-9c1b-e434a81f754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.323047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17534688-e7be-4f48-9c1b-e434a81f754e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.323373 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17534688-e7be-4f48-9c1b-e434a81f754e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.323587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17534688-e7be-4f48-9c1b-e434a81f754e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.333067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17534688-e7be-4f48-9c1b-e434a81f754e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-17534688-e7be-4f48-9c1b-e434a81f754e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:52.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:52.338999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:28:52.340109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 587/1188] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:52.344910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ad44-6a5c-445c-8dc1-3f04301f6ee4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.441589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793ad44-6a5c-445c-8dc1-3f04301f6ee4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.473376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a9432-8a6a-4b50-8a02-e516b2b51673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.473987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a9432-8a6a-4b50-8a02-e516b2b51673 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.474269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a9432-8a6a-4b50-8a02-e516b2b51673 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.474542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a9432-8a6a-4b50-8a02-e516b2b51673 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.475267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a9432-8a6a-4b50-8a02-e516b2b51673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:52.475573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a9432-8a6a-4b50-8a02-e516b2b51673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.476994 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a9432-8a6a-4b50-8a02-e516b2b51673 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.486325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 602/1189] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:52.492231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17534688-e7be-4f48-9c1b-e434a81f754e None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.505262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:52.587753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17534688-e7be-4f48-9c1b-e434a81f754e None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.620148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b06833-abfe-4314-879b-82d2f27c29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.620769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06833-abfe-4314-879b-82d2f27c29ff None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.621042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06833-abfe-4314-879b-82d2f27c29ff None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.621310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b06833-abfe-4314-879b-82d2f27c29ff None admin] PATH_INFO: `/v3/users/e4301f2645ce47a4aada37d4c7ad915f` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.622438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b06833-abfe-4314-879b-82d2f27c29ff None admin] RBAC: Authorizing `identity:get_user(user_id=e4301f2645ce47a4aada37d4c7ad915f)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.623880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b06833-abfe-4314-879b-82d2f27c29ff None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.625473 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 588/1190] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/users/e4301f2645ce47a4aada37d4c7ad915f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:52.631127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a9432-8a6a-4b50-8a02-e516b2b51673 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.646847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:52.727102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a9432-8a6a-4b50-8a02-e516b2b51673 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.759230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff55f1-9172-428d-8f17-98352ca79bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.759870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff55f1-9172-428d-8f17-98352ca79bed None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.760190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff55f1-9172-428d-8f17-98352ca79bed None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.760495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff55f1-9172-428d-8f17-98352ca79bed None admin] PATH_INFO: `/v3/projects/5db3aced0cb34df293f1b049d709a300` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.761659 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff55f1-9172-428d-8f17-98352ca79bed None admin] RBAC: Authorizing `identity:get_project(project_id=5db3aced0cb34df293f1b049d709a300)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.763121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff55f1-9172-428d-8f17-98352ca79bed None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.764805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 603/1191] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/projects/5db3aced0cb34df293f1b049d709a300 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:52.770745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b06833-abfe-4314-879b-82d2f27c29ff None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.848380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:52.870336 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b06833-abfe-4314-879b-82d2f27c29ff None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.902417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c23c40-adb9-4399-8071-8c8cea815068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.903071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c23c40-adb9-4399-8071-8c8cea815068 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.903354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c23c40-adb9-4399-8071-8c8cea815068 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.903628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c23c40-adb9-4399-8071-8c8cea815068 None admin] PATH_INFO: `/v3/projects/5db3aced0cb34df293f1b049d709a300/users/e4301f2645ce47a4aada37d4c7ad915f/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.906089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c23c40-adb9-4399-8071-8c8cea815068 None admin] RBAC: Authorizing `identity:create_grant(project_id=5db3aced0cb34df293f1b049d709a300, user_id=e4301f2645ce47a4aada37d4c7ad915f, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.907510 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c23c40-adb9-4399-8071-8c8cea815068 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.921123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 589/1192] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:52 2022] PUT /identity/v3/projects/5db3aced0cb34df293f1b049d709a300/users/e4301f2645ce47a4aada37d4c7ad915f/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:54.880519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5a1b9-da86-4d6e-8088-95c36044cd6c None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.881013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5a1b9-da86-4d6e-8088-95c36044cd6c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.881108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f5a1b9-da86-4d6e-8088-95c36044cd6c None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.882411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 604/1193] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:54.887632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4fa2d-51ee-41af-be36-83ac5d599d43 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.888039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4fa2d-51ee-41af-be36-83ac5d599d43 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.888785 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4fa2d-51ee-41af-be36-83ac5d599d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.906565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e3e4fa2d-51ee-41af-be36-83ac5d599d43 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:54.907724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e3e4fa2d-51ee-41af-be36-83ac5d599d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:54.971530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 590/1194] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:54.993666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5a1b9-da86-4d6e-8088-95c36044cd6c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.074000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:55.092924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f5a1b9-da86-4d6e-8088-95c36044cd6c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.125383 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6a220-8b26-4b81-b9b7-ee3731016d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.126003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6a220-8b26-4b81-b9b7-ee3731016d29 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.126288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6a220-8b26-4b81-b9b7-ee3731016d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.126573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6a220-8b26-4b81-b9b7-ee3731016d29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.136362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f6a220-8b26-4b81-b9b7-ee3731016d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-d1f6a220-8b26-4b81-b9b7-ee3731016d29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:55.141857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:55.142910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:28:55.143768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 605/1195] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:55.148868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4fa2d-51ee-41af-be36-83ac5d599d43 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.216684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:55.253028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4fa2d-51ee-41af-be36-83ac5d599d43 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.285066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b4e76-f3a1-44ce-935c-f97210133f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.285673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b4e76-f3a1-44ce-935c-f97210133f30 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.285975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b4e76-f3a1-44ce-935c-f97210133f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.286246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b4e76-f3a1-44ce-935c-f97210133f30 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.286955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b4e76-f3a1-44ce-935c-f97210133f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:55.287255 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b4e76-f3a1-44ce-935c-f97210133f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:55.288640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b4e76-f3a1-44ce-935c-f97210133f30 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:55.296842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 591/1196] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:55.302595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6a220-8b26-4b81-b9b7-ee3731016d29 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.398709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6a220-8b26-4b81-b9b7-ee3731016d29 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.431067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08a619-8d8e-4701-9c82-b2bbc05bf6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.431681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a619-8d8e-4701-9c82-b2bbc05bf6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.431960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a619-8d8e-4701-9c82-b2bbc05bf6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.432260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08a619-8d8e-4701-9c82-b2bbc05bf6f9 None admin] PATH_INFO: `/v3/users/e4301f2645ce47a4aada37d4c7ad915f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.433401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08a619-8d8e-4701-9c82-b2bbc05bf6f9 None admin] RBAC: Authorizing `identity:get_user(user_id=e4301f2645ce47a4aada37d4c7ad915f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:55.434815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08a619-8d8e-4701-9c82-b2bbc05bf6f9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:55.436966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 606/1197] 10.222.0.57 () {56 vars in 1177 bytes} [Tue Aug 2 21:28:55 2022] GET /identity/v3/users/e4301f2645ce47a4aada37d4c7ad915f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:55.442717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b4e76-f3a1-44ce-935c-f97210133f30 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.542149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b4e76-f3a1-44ce-935c-f97210133f30 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.570223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:55.576315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698367-618c-4cbf-a2eb-ecaad54ab836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.576931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698367-618c-4cbf-a2eb-ecaad54ab836 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.577213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698367-618c-4cbf-a2eb-ecaad54ab836 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.577488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef698367-618c-4cbf-a2eb-ecaad54ab836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.641761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698367-618c-4cbf-a2eb-ecaad54ab836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:55.643184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef698367-618c-4cbf-a2eb-ecaad54ab836 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:55.738436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 592/1198] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:55.744300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08a619-8d8e-4701-9c82-b2bbc05bf6f9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.756122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:55.841525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08a619-8d8e-4701-9c82-b2bbc05bf6f9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.874013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3037112-5f4e-4d14-8f18-775c4d236434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.874642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037112-5f4e-4d14-8f18-775c4d236434 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.874925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037112-5f4e-4d14-8f18-775c4d236434 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.875200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3037112-5f4e-4d14-8f18-775c4d236434 None admin] PATH_INFO: `/v3/projects/5db3aced0cb34df293f1b049d709a300` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.876369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3037112-5f4e-4d14-8f18-775c4d236434 None admin] RBAC: Authorizing `identity:get_project(project_id=5db3aced0cb34df293f1b049d709a300)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:55.877809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3037112-5f4e-4d14-8f18-775c4d236434 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:55.879442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 607/1199] 10.222.0.57 () {56 vars in 1186 bytes} [Tue Aug 2 21:28:55 2022] GET /identity/v3/projects/5db3aced0cb34df293f1b049d709a300 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:55.885529 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698367-618c-4cbf-a2eb-ecaad54ab836 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.914869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:55.982804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef698367-618c-4cbf-a2eb-ecaad54ab836 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:56.015412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa9decb-dc67-477d-b430-99170d514acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:56.015963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9decb-dc67-477d-b430-99170d514acc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:56.016273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9decb-dc67-477d-b430-99170d514acc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:56.016550 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa9decb-dc67-477d-b430-99170d514acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:56.017334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9decb-dc67-477d-b430-99170d514acc None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=5db3aced0cb34df293f1b049d709a300, user.id=e4301f2645ce47a4aada37d4c7ad915f) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:56.017644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9decb-dc67-477d-b430-99170d514acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:56.019053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa9decb-dc67-477d-b430-99170d514acc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:56.024648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 593/1200] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:55 2022] GET /identity/v3/role_assignments?user.id=e4301f2645ce47a4aada37d4c7ad915f&scope.project.id=5db3aced0cb34df293f1b049d709a300&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:05.869398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=61 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:06.022094 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=53 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:50.792680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf9b22-434e-4bcc-b280-3cb213f8d4e6 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:50.793308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf9b22-434e-4bcc-b280-3cb213f8d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:50.793308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf9b22-434e-4bcc-b280-3cb213f8d4e6 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:50.794523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 608/1201] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:29:50.800360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c5fc7-46ba-4dbe-a880-75266c607832 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:50.800844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c5fc7-46ba-4dbe-a880-75266c607832 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:50.801118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c5fc7-46ba-4dbe-a880-75266c607832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:50.821506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-846c5fc7-46ba-4dbe-a880-75266c607832 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:50.823779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-846c5fc7-46ba-4dbe-a880-75266c607832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:50.920714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 594/1202] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:50.950291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf9b22-434e-4bcc-b280-3cb213f8d4e6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:51.083679 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf9b22-434e-4bcc-b280-3cb213f8d4e6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:51.126505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba535b5-aa99-4411-9ac1-f09aa1e6baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:51.127148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba535b5-aa99-4411-9ac1-f09aa1e6baa3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:51.127479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba535b5-aa99-4411-9ac1-f09aa1e6baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:51.127741 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba535b5-aa99-4411-9ac1-f09aa1e6baa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:51.142805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba535b5-aa99-4411-9ac1-f09aa1e6baa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:51.144920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba535b5-aa99-4411-9ac1-f09aa1e6baa3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-6ba535b5-aa99-4411-9ac1-f09aa1e6baa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:51.177026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:51.178246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:51.179489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:51.179489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:51.179489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:51.179489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:29:51.187867 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 609/1203] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:51.189670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c5fc7-46ba-4dbe-a880-75266c607832 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:51.347230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c5fc7-46ba-4dbe-a880-75266c607832 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:51.389367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:51.397134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bacc02-ac93-490e-a842-ca0072afe87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:51.397820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bacc02-ac93-490e-a842-ca0072afe87f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:51.398107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bacc02-ac93-490e-a842-ca0072afe87f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:51.398386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bacc02-ac93-490e-a842-ca0072afe87f None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:51.399152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bacc02-ac93-490e-a842-ca0072afe87f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:51.399459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bacc02-ac93-490e-a842-ca0072afe87f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:51.403653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bacc02-ac93-490e-a842-ca0072afe87f None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:51.416730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 595/1204] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:51.423904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba535b5-aa99-4411-9ac1-f09aa1e6baa3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:51.496837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:51.570575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba535b5-aa99-4411-9ac1-f09aa1e6baa3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:51.612843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aac95b-03ab-446d-bbcf-ac37552fb76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:51.613433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aac95b-03ab-446d-bbcf-ac37552fb76a None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:51.613756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aac95b-03ab-446d-bbcf-ac37552fb76a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:51.614035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aac95b-03ab-446d-bbcf-ac37552fb76a None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:51.614926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aac95b-03ab-446d-bbcf-ac37552fb76a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:51.616479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aac95b-03ab-446d-bbcf-ac37552fb76a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:51.643583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 610/1205] 10.222.0.57 () {60 vars in 1132 bytes} [Tue Aug 2 21:29:51 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:29:53.772681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e2979-ab19-4b45-a2e6-3f2fb0dc8c7d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:53.773358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e2979-ab19-4b45-a2e6-3f2fb0dc8c7d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:53.773358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e2979-ab19-4b45-a2e6-3f2fb0dc8c7d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:53.774612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 596/1206] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:53.780775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb77c1e-59a9-4287-b3ca-a789cf9bfb3b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:53.781367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb77c1e-59a9-4287-b3ca-a789cf9bfb3b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:53.781367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb77c1e-59a9-4287-b3ca-a789cf9bfb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:53.805260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-fbb77c1e-59a9-4287-b3ca-a789cf9bfb3b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:53.808377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fbb77c1e-59a9-4287-b3ca-a789cf9bfb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:53.894547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 611/1207] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:53.921394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e2979-ab19-4b45-a2e6-3f2fb0dc8c7d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:54.042393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e2979-ab19-4b45-a2e6-3f2fb0dc8c7d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:54.080597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec603-d1a8-4fd9-a5be-9a5ed300ddc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:54.081329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec603-d1a8-4fd9-a5be-9a5ed300ddc3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:54.081600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec603-d1a8-4fd9-a5be-9a5ed300ddc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:54.081909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec603-d1a8-4fd9-a5be-9a5ed300ddc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:54.094451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ec603-d1a8-4fd9-a5be-9a5ed300ddc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-795ec603-d1a8-4fd9-a5be-9a5ed300ddc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:54.099327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:54.104476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:29:54.105544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 597/1208] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:29:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:54.107698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb77c1e-59a9-4287-b3ca-a789cf9bfb3b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:54.154688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:54.221345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb77c1e-59a9-4287-b3ca-a789cf9bfb3b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:54.258159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf93eb-6467-451c-91c4-4414b1fd15f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:54.258773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf93eb-6467-451c-91c4-4414b1fd15f3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:54.259210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf93eb-6467-451c-91c4-4414b1fd15f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:54.259442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf93eb-6467-451c-91c4-4414b1fd15f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:54.260238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf93eb-6467-451c-91c4-4414b1fd15f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:54.260546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf93eb-6467-451c-91c4-4414b1fd15f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:54.262027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf93eb-6467-451c-91c4-4414b1fd15f3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:54.270564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 612/1209] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:29:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:54.277471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec603-d1a8-4fd9-a5be-9a5ed300ddc3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:54.342397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:54.397775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec603-d1a8-4fd9-a5be-9a5ed300ddc3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:54.440112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919297-19e4-4c38-b04b-9a3dc59cdfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:54.440112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919297-19e4-4c38-b04b-9a3dc59cdfaa None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:54.440112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919297-19e4-4c38-b04b-9a3dc59cdfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:54.440112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89919297-19e4-4c38-b04b-9a3dc59cdfaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:54.452816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89919297-19e4-4c38-b04b-9a3dc59cdfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:54.454303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89919297-19e4-4c38-b04b-9a3dc59cdfaa None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-89919297-19e4-4c38-b04b-9a3dc59cdfaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:54.470826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:54.471959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:54.477808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:54.477808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:54.477808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:54.477808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:29:54.477808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 598/1210] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:54.480327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf93eb-6467-451c-91c4-4414b1fd15f3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:54.592342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:54.598289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf93eb-6467-451c-91c4-4414b1fd15f3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:54.634551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46373aa-bc36-4469-84c0-dd53942fadd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:54.635218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46373aa-bc36-4469-84c0-dd53942fadd3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:54.635523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46373aa-bc36-4469-84c0-dd53942fadd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:54.635822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46373aa-bc36-4469-84c0-dd53942fadd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:54.636606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46373aa-bc36-4469-84c0-dd53942fadd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:54.637700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46373aa-bc36-4469-84c0-dd53942fadd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:54.638494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46373aa-bc36-4469-84c0-dd53942fadd3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:54.652060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 613/1211] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:54.660838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919297-19e4-4c38-b04b-9a3dc59cdfaa None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:54.778468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89919297-19e4-4c38-b04b-9a3dc59cdfaa None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:54.780190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:54.818276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdca980-c37e-44da-8634-a156a2be3a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:54.818925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdca980-c37e-44da-8634-a156a2be3a0a None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:54.819203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdca980-c37e-44da-8634-a156a2be3a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:54.819471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdca980-c37e-44da-8634-a156a2be3a0a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:54.827809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdca980-c37e-44da-8634-a156a2be3a0a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:54.829288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdca980-c37e-44da-8634-a156a2be3a0a None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-dcdca980-c37e-44da-8634-a156a2be3a0a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:29:54.842089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:54.845326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:29:54.846498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 599/1212] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:54.849248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46373aa-bc36-4469-84c0-dd53942fadd3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:54.991366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46373aa-bc36-4469-84c0-dd53942fadd3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:55.032756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa40023-c029-4194-818c-2e16978c2c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:55.033442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa40023-c029-4194-818c-2e16978c2c85 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:55.033811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa40023-c029-4194-818c-2e16978c2c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:55.034071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa40023-c029-4194-818c-2e16978c2c85 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:55.034940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa40023-c029-4194-818c-2e16978c2c85 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:55.035251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa40023-c029-4194-818c-2e16978c2c85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:55.036814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa40023-c029-4194-818c-2e16978c2c85 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:55.059355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 614/1213] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 21:29:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:55.062856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdca980-c37e-44da-8634-a156a2be3a0a None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:55.176869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdca980-c37e-44da-8634-a156a2be3a0a None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:55.217370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e938b-f90d-4aba-8612-2591aca49bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:55.217920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e938b-f90d-4aba-8612-2591aca49bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:55.218203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e938b-f90d-4aba-8612-2591aca49bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:55.218469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e938b-f90d-4aba-8612-2591aca49bb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:55.254795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:55.309709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e938b-f90d-4aba-8612-2591aca49bb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:55.311308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e938b-f90d-4aba-8612-2591aca49bb9 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:55.455931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 600/1214] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:55.457701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa40023-c029-4194-818c-2e16978c2c85 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:55.480783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:55.586647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa40023-c029-4194-818c-2e16978c2c85 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:55.633808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648ebe7-decc-4a56-a339-e969bf09afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:55.634499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ebe7-decc-4a56-a339-e969bf09afea None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:55.634783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ebe7-decc-4a56-a339-e969bf09afea None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:55.635063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648ebe7-decc-4a56-a339-e969bf09afea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:55.652703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648ebe7-decc-4a56-a339-e969bf09afea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:55.654963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648ebe7-decc-4a56-a339-e969bf09afea None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-f648ebe7-decc-4a56-a339-e969bf09afea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:55.677916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:55.679467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:55.680665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:55.680665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:55.680665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:55.680665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:29:55.685615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 615/1215] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:55.686719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e938b-f90d-4aba-8612-2591aca49bb9 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:55.770311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:55.812799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e938b-f90d-4aba-8612-2591aca49bb9 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:55.851071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63924e88-54e1-4caa-8422-a9a0bf0eb282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:55.851647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63924e88-54e1-4caa-8422-a9a0bf0eb282 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:55.851908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63924e88-54e1-4caa-8422-a9a0bf0eb282 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:55.852204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63924e88-54e1-4caa-8422-a9a0bf0eb282 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:55.853566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63924e88-54e1-4caa-8422-a9a0bf0eb282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:55.853839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63924e88-54e1-4caa-8422-a9a0bf0eb282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:55.855178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63924e88-54e1-4caa-8422-a9a0bf0eb282 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:55.868353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 601/1216] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:55.873028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648ebe7-decc-4a56-a339-e969bf09afea None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:55.955872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:55.995859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648ebe7-decc-4a56-a339-e969bf09afea None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:56.053207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744203c-9818-4228-87dc-21dd74214055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:56.054115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744203c-9818-4228-87dc-21dd74214055 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:56.054404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744203c-9818-4228-87dc-21dd74214055 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:56.054713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744203c-9818-4228-87dc-21dd74214055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:56.063635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744203c-9818-4228-87dc-21dd74214055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:56.066264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5744203c-9818-4228-87dc-21dd74214055 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5744203c-9818-4228-87dc-21dd74214055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:29:56.080492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:56.081696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:56.082827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:29:56.082827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:29:56.082827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:29:56.082827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:29:56.082827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:29:56.082827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:29:56.082827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:29:56.082827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:29:56.083384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 616/1217] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:56.089769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63924e88-54e1-4caa-8422-a9a0bf0eb282 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:56.204173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63924e88-54e1-4caa-8422-a9a0bf0eb282 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:56.230595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:56.242791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8404c51-a9c3-4144-a44d-21987937807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:56.243486 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404c51-a9c3-4144-a44d-21987937807e None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:56.243786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404c51-a9c3-4144-a44d-21987937807e None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:56.244054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8404c51-a9c3-4144-a44d-21987937807e None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:56.244841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8404c51-a9c3-4144-a44d-21987937807e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:56.245148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8404c51-a9c3-4144-a44d-21987937807e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:56.246569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8404c51-a9c3-4144-a44d-21987937807e None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:56.260382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 602/1218] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:56.267035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744203c-9818-4228-87dc-21dd74214055 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:56.389011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744203c-9818-4228-87dc-21dd74214055 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:56.417349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:56.424150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc688ea-16d3-4a97-9a27-c140e4838be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:56.424801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc688ea-16d3-4a97-9a27-c140e4838be2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:56.425071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc688ea-16d3-4a97-9a27-c140e4838be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:56.425367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc688ea-16d3-4a97-9a27-c140e4838be2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:56.426221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc688ea-16d3-4a97-9a27-c140e4838be2 None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=ad52cba0b761482d96b6659654034ba6) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:56.426550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc688ea-16d3-4a97-9a27-c140e4838be2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:56.428049 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc688ea-16d3-4a97-9a27-c140e4838be2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:56.444670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 617/1219] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:56 2022] GET /identity/v3/role_assignments?user.id=ad52cba0b761482d96b6659654034ba6&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:58.599228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e86f2a-059b-495f-9757-e7649ee5d80d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:58.599782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e86f2a-059b-495f-9757-e7649ee5d80d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:58.599782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e86f2a-059b-495f-9757-e7649ee5d80d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:58.601176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 603/1220] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:58.606476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac502316-20cf-42f6-b74c-085af82e7944 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:58.608253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac502316-20cf-42f6-b74c-085af82e7944 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:58.608253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac502316-20cf-42f6-b74c-085af82e7944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:58.625459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ac502316-20cf-42f6-b74c-085af82e7944 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:58.626640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ac502316-20cf-42f6-b74c-085af82e7944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:58.694473 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 618/1221] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:58.717051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e86f2a-059b-495f-9757-e7649ee5d80d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:58.836384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e86f2a-059b-495f-9757-e7649ee5d80d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:58.874183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bde16-d072-47e1-9d52-93f56ccec32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:58.874874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bde16-d072-47e1-9d52-93f56ccec32f None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:58.875179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bde16-d072-47e1-9d52-93f56ccec32f None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:58.875446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320bde16-d072-47e1-9d52-93f56ccec32f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:58.887543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320bde16-d072-47e1-9d52-93f56ccec32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-320bde16-d072-47e1-9d52-93f56ccec32f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:58.892730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:58.893727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:29:58.894535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 604/1222] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:29:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:58.900890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac502316-20cf-42f6-b74c-085af82e7944 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:59.005632 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac502316-20cf-42f6-b74c-085af82e7944 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:59.031674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:59.045340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041bf74-6d9a-4910-b9c5-720b4ba21ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:59.045950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041bf74-6d9a-4910-b9c5-720b4ba21ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:59.046225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041bf74-6d9a-4910-b9c5-720b4ba21ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:59.046499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041bf74-6d9a-4910-b9c5-720b4ba21ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:59.047218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041bf74-6d9a-4910-b9c5-720b4ba21ef2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:59.047521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041bf74-6d9a-4910-b9c5-720b4ba21ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:59.048995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041bf74-6d9a-4910-b9c5-720b4ba21ef2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:59.062010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 619/1223] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:29:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:59.069496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bde16-d072-47e1-9d52-93f56ccec32f None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:59.124972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:59.186255 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320bde16-d072-47e1-9d52-93f56ccec32f None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:59.222024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143b6dd-256f-4132-9d69-ca11fe269c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:59.222714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143b6dd-256f-4132-9d69-ca11fe269c18 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:59.223084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143b6dd-256f-4132-9d69-ca11fe269c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:59.223378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143b6dd-256f-4132-9d69-ca11fe269c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:59.235618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143b6dd-256f-4132-9d69-ca11fe269c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:59.237377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143b6dd-256f-4132-9d69-ca11fe269c18 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b143b6dd-256f-4132-9d69-ca11fe269c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:59.254154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:59.255496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:59.256496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:59.256496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:59.256496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:59.256496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:29:59.256496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 605/1224] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:59.262400 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041bf74-6d9a-4910-b9c5-720b4ba21ef2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:59.372412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041bf74-6d9a-4910-b9c5-720b4ba21ef2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:59.408040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267c5e7-eedd-40da-a3af-342f84460ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:59.408683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267c5e7-eedd-40da-a3af-342f84460ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:59.409004 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267c5e7-eedd-40da-a3af-342f84460ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:59.409375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267c5e7-eedd-40da-a3af-342f84460ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:59.410160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267c5e7-eedd-40da-a3af-342f84460ea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:59.410555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267c5e7-eedd-40da-a3af-342f84460ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:59.412094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267c5e7-eedd-40da-a3af-342f84460ea2 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:59.430577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 620/1225] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:59.431673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143b6dd-256f-4132-9d69-ca11fe269c18 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:59.534724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:59.542642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143b6dd-256f-4132-9d69-ca11fe269c18 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:59.583994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc0c5-cc3a-49df-976d-168f60b9eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:59.584665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc0c5-cc3a-49df-976d-168f60b9eddc None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:59.584949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc0c5-cc3a-49df-976d-168f60b9eddc None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:59.585220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc0c5-cc3a-49df-976d-168f60b9eddc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:59.593504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafc0c5-cc3a-49df-976d-168f60b9eddc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:59.594933 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafc0c5-cc3a-49df-976d-168f60b9eddc None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-4bafc0c5-cc3a-49df-976d-168f60b9eddc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:29:59.606621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:59.608040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:29:59.609124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 606/1226] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:59.613835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267c5e7-eedd-40da-a3af-342f84460ea2 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:59.660720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:59.716014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267c5e7-eedd-40da-a3af-342f84460ea2 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:59.751117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c410f4-5662-42ef-b40c-51c95d250066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:59.752510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c410f4-5662-42ef-b40c-51c95d250066 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:59.752790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c410f4-5662-42ef-b40c-51c95d250066 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:59.753061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c410f4-5662-42ef-b40c-51c95d250066 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:59.753964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c410f4-5662-42ef-b40c-51c95d250066 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:59.754340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c410f4-5662-42ef-b40c-51c95d250066 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:59.755933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c410f4-5662-42ef-b40c-51c95d250066 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:59.776738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 621/1227] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 21:29:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:59.782676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc0c5-cc3a-49df-976d-168f60b9eddc None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:59.890836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc0c5-cc3a-49df-976d-168f60b9eddc None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:59.927249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a03d8-021f-4d8e-96cd-0bf1b3a83540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:59.927798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a03d8-021f-4d8e-96cd-0bf1b3a83540 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:59.928083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a03d8-021f-4d8e-96cd-0bf1b3a83540 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:59.928378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a03d8-021f-4d8e-96cd-0bf1b3a83540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:59.938791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a03d8-021f-4d8e-96cd-0bf1b3a83540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:59.940251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a03d8-021f-4d8e-96cd-0bf1b3a83540 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-597a03d8-021f-4d8e-96cd-0bf1b3a83540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:59.954673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:59.955676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:59.957099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:59.957099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:59.957099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:59.957099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:29:59.957099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 607/1228] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:59.961634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c410f4-5662-42ef-b40c-51c95d250066 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:00.066204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c410f4-5662-42ef-b40c-51c95d250066 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:00.068624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:00.103059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24220fc-ce40-4d9c-a291-ef2ad611392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:00.103640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24220fc-ce40-4d9c-a291-ef2ad611392e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:00.103919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24220fc-ce40-4d9c-a291-ef2ad611392e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:00.104224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24220fc-ce40-4d9c-a291-ef2ad611392e None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:00.104906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24220fc-ce40-4d9c-a291-ef2ad611392e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:00.105212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24220fc-ce40-4d9c-a291-ef2ad611392e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:00.106574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24220fc-ce40-4d9c-a291-ef2ad611392e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:00.117775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 622/1229] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:00.124066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a03d8-021f-4d8e-96cd-0bf1b3a83540 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:00.133209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:00.234397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a03d8-021f-4d8e-96cd-0bf1b3a83540 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:00.268604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee368932-2de2-4ebe-8f73-513fb4dc1e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:00.269249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368932-2de2-4ebe-8f73-513fb4dc1e34 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:00.269533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368932-2de2-4ebe-8f73-513fb4dc1e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:00.269809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368932-2de2-4ebe-8f73-513fb4dc1e34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:00.277628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee368932-2de2-4ebe-8f73-513fb4dc1e34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:00.279072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee368932-2de2-4ebe-8f73-513fb4dc1e34 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ee368932-2de2-4ebe-8f73-513fb4dc1e34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:30:00.293113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:00.294031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:00.294888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:30:00.294888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:30:00.294888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:30:00.294888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:30:00.294888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:30:00.294888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:30:00.294888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:00.294888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:00.294888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 608/1230] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:30:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:00.300675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24220fc-ce40-4d9c-a291-ef2ad611392e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:00.407780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24220fc-ce40-4d9c-a291-ef2ad611392e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:00.443864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dc2e1-2278-465d-8fcc-598da480589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:00.444573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dc2e1-2278-465d-8fcc-598da480589a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:00.444852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dc2e1-2278-465d-8fcc-598da480589a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:00.445129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dc2e1-2278-465d-8fcc-598da480589a None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:00.445976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dc2e1-2278-465d-8fcc-598da480589a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:00.446314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dc2e1-2278-465d-8fcc-598da480589a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:00.447828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dc2e1-2278-465d-8fcc-598da480589a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:00.465732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 623/1231] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:30:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:00.467408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee368932-2de2-4ebe-8f73-513fb4dc1e34 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:00.542165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:00.582383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee368932-2de2-4ebe-8f73-513fb4dc1e34 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:00.620372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec521a5-1368-44e6-bf48-5a92d9107426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:00.621075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec521a5-1368-44e6-bf48-5a92d9107426 None admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:00.621298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec521a5-1368-44e6-bf48-5a92d9107426 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:00.621569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec521a5-1368-44e6-bf48-5a92d9107426 None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/ad52cba0b761482d96b6659654034ba6/roles/78cbd44006c3419d916364b7251b1ae4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:00.640603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec521a5-1368-44e6-bf48-5a92d9107426 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=ad52cba0b761482d96b6659654034ba6, role_id=78cbd44006c3419d916364b7251b1ae4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:00.642245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec521a5-1368-44e6-bf48-5a92d9107426 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:00.655114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 609/1232] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:30:00 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/ad52cba0b761482d96b6659654034ba6/roles/78cbd44006c3419d916364b7251b1ae4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:30:02.646621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b19d6-4ee3-415f-8f6f-e99a267a5899 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:02.647238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b19d6-4ee3-415f-8f6f-e99a267a5899 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:02.647238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b19d6-4ee3-415f-8f6f-e99a267a5899 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:02.648609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 624/1233] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:02.654891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50239d2d-84d3-4efe-8db9-1be45d32615d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:02.655333 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50239d2d-84d3-4efe-8db9-1be45d32615d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:02.655427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50239d2d-84d3-4efe-8db9-1be45d32615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:02.674613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-50239d2d-84d3-4efe-8db9-1be45d32615d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:02.675905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-50239d2d-84d3-4efe-8db9-1be45d32615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:02.757324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 610/1234] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:02.782121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b19d6-4ee3-415f-8f6f-e99a267a5899 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:02.809380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:02.891764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b19d6-4ee3-415f-8f6f-e99a267a5899 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:02.927470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f9322-4ac0-4113-9ce1-437810872711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:02.928024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f9322-4ac0-4113-9ce1-437810872711 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:02.928340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f9322-4ac0-4113-9ce1-437810872711 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:02.928610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f9322-4ac0-4113-9ce1-437810872711 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:02.939809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f9322-4ac0-4113-9ce1-437810872711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-658f9322-4ac0-4113-9ce1-437810872711 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:30:02.944711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:02.945648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:02.946734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 625/1235] 10.222.0.57 () {56 vars in 1102 bytes} [Tue Aug 2 21:30:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:02.952104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50239d2d-84d3-4efe-8db9-1be45d32615d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:03.003227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:03.065001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50239d2d-84d3-4efe-8db9-1be45d32615d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:03.112444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836adf17-9ec8-4bbf-8770-b3a332f0dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:03.113062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836adf17-9ec8-4bbf-8770-b3a332f0dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:03.113341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836adf17-9ec8-4bbf-8770-b3a332f0dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:03.113607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836adf17-9ec8-4bbf-8770-b3a332f0dfe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:03.114544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836adf17-9ec8-4bbf-8770-b3a332f0dfe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:03.114859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836adf17-9ec8-4bbf-8770-b3a332f0dfe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:03.116379 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836adf17-9ec8-4bbf-8770-b3a332f0dfe0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:03.125911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 611/1236] 10.222.0.57 () {56 vars in 1103 bytes} [Tue Aug 2 21:30:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:03.131540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f9322-4ac0-4113-9ce1-437810872711 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:03.217881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:03.234687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f9322-4ac0-4113-9ce1-437810872711 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:03.269652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b9421-01f6-4805-8798-bdf21a913fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:03.270283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b9421-01f6-4805-8798-bdf21a913fec None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:03.270561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b9421-01f6-4805-8798-bdf21a913fec None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:03.270844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b9421-01f6-4805-8798-bdf21a913fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:03.285828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b9421-01f6-4805-8798-bdf21a913fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:03.287283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b9421-01f6-4805-8798-bdf21a913fec None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3f4b9421-01f6-4805-8798-bdf21a913fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:03.307521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:03.308735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:03.310028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:03.310028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:03.310028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:03.310028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:03.310028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 626/1237] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:03.314505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836adf17-9ec8-4bbf-8770-b3a332f0dfe0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:03.431166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836adf17-9ec8-4bbf-8770-b3a332f0dfe0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:03.442167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:03.470475 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206e81-0b8b-4497-9ab6-a53fb8d5e4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:03.470654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206e81-0b8b-4497-9ab6-a53fb8d5e4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:03.470929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206e81-0b8b-4497-9ab6-a53fb8d5e4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:03.471297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c206e81-0b8b-4497-9ab6-a53fb8d5e4d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:03.472088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c206e81-0b8b-4497-9ab6-a53fb8d5e4d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:03.472479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c206e81-0b8b-4497-9ab6-a53fb8d5e4d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:03.474199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c206e81-0b8b-4497-9ab6-a53fb8d5e4d3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:03.487939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 612/1238] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:03.494195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b9421-01f6-4805-8798-bdf21a913fec None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:03.613061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b9421-01f6-4805-8798-bdf21a913fec None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:03.650509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398094cb-300b-4c94-807e-73df1022e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:03.651208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398094cb-300b-4c94-807e-73df1022e6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:03.651423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398094cb-300b-4c94-807e-73df1022e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:03.651698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398094cb-300b-4c94-807e-73df1022e6a6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:03.654839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:03.660428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398094cb-300b-4c94-807e-73df1022e6a6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:03.662159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398094cb-300b-4c94-807e-73df1022e6a6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-398094cb-300b-4c94-807e-73df1022e6a6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:30:03.673734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:03.674947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:03.676192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:03.681253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 627/1239] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:03.681369 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206e81-0b8b-4497-9ab6-a53fb8d5e4d3 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:03.791913 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c206e81-0b8b-4497-9ab6-a53fb8d5e4d3 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:03.830466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b211f-93d4-47f7-9365-747f3e1fe113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:03.831088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b211f-93d4-47f7-9365-747f3e1fe113 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:03.831366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b211f-93d4-47f7-9365-747f3e1fe113 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:03.831667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b211f-93d4-47f7-9365-747f3e1fe113 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:03.832487 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b211f-93d4-47f7-9365-747f3e1fe113 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:03.832792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b211f-93d4-47f7-9365-747f3e1fe113 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:03.834211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b211f-93d4-47f7-9365-747f3e1fe113 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:03.852970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 613/1240] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 21:30:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:03.858763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398094cb-300b-4c94-807e-73df1022e6a6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:03.976858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398094cb-300b-4c94-807e-73df1022e6a6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:04.016556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6139ba3-c79c-4294-9f13-07402bf52c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:04.017219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139ba3-c79c-4294-9f13-07402bf52c22 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:04.017511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139ba3-c79c-4294-9f13-07402bf52c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:04.017795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6139ba3-c79c-4294-9f13-07402bf52c22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:04.081791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:04.089538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6139ba3-c79c-4294-9f13-07402bf52c22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:04.091004 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6139ba3-c79c-4294-9f13-07402bf52c22 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:04.202845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 628/1241] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:30:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:30:04.209291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b211f-93d4-47f7-9365-747f3e1fe113 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:04.238285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:04.318987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b211f-93d4-47f7-9365-747f3e1fe113 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:04.358261 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85268094-634d-46a0-94bd-9ac3998a6404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:04.358955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85268094-634d-46a0-94bd-9ac3998a6404 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:04.359238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85268094-634d-46a0-94bd-9ac3998a6404 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:04.359545 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85268094-634d-46a0-94bd-9ac3998a6404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:04.372238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85268094-634d-46a0-94bd-9ac3998a6404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:04.373827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85268094-634d-46a0-94bd-9ac3998a6404 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-85268094-634d-46a0-94bd-9ac3998a6404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:04.390430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:04.391718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:04.392990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:04.392990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:04.392990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:04.392990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:04.392990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 614/1242] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:30:04.398441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6139ba3-c79c-4294-9f13-07402bf52c22 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:04.500770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:04.509482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6139ba3-c79c-4294-9f13-07402bf52c22 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:04.558738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533b7a-d075-42a6-bd06-bad0632cb857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:04.559390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533b7a-d075-42a6-bd06-bad0632cb857 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:04.559666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533b7a-d075-42a6-bd06-bad0632cb857 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:04.559919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533b7a-d075-42a6-bd06-bad0632cb857 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:04.560660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533b7a-d075-42a6-bd06-bad0632cb857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:04.560966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533b7a-d075-42a6-bd06-bad0632cb857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:04.562335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533b7a-d075-42a6-bd06-bad0632cb857 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:04.575454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 629/1243] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:04.581152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85268094-634d-46a0-94bd-9ac3998a6404 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:04.666942 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:04.691878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85268094-634d-46a0-94bd-9ac3998a6404 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:04.728896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ac3b-4071-41de-b4f2-93c937843c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:04.729537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ac3b-4071-41de-b4f2-93c937843c85 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:04.729822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ac3b-4071-41de-b4f2-93c937843c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:04.730096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ac3b-4071-41de-b4f2-93c937843c85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:04.736950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ac3b-4071-41de-b4f2-93c937843c85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:04.738546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1ac3b-4071-41de-b4f2-93c937843c85 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-9ad1ac3b-4071-41de-b4f2-93c937843c85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:30:04.752570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:04.753664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:04.754570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:30:04.754570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:30:04.754570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:30:04.754570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:30:04.754570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:30:04.754570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:30:04.754570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:04.754570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:04.754570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 615/1244] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:30:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:04.760235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533b7a-d075-42a6-bd06-bad0632cb857 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:04.872569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533b7a-d075-42a6-bd06-bad0632cb857 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:04.911888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc6027-b8ee-44aa-b552-e556604ce81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:04.912551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6027-b8ee-44aa-b552-e556604ce81f None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:04.912835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6027-b8ee-44aa-b552-e556604ce81f None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:04.913140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc6027-b8ee-44aa-b552-e556604ce81f None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:04.913950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6027-b8ee-44aa-b552-e556604ce81f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:04.914262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6027-b8ee-44aa-b552-e556604ce81f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:04.916401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc6027-b8ee-44aa-b552-e556604ce81f None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:04.931117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 630/1245] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:30:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:04.937516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ac3b-4071-41de-b4f2-93c937843c85 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:05.048347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ac3b-4071-41de-b4f2-93c937843c85 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:05.082858 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a031ce56-6b5f-462c-adbc-0c938e602519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:05.083484 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031ce56-6b5f-462c-adbc-0c938e602519 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:05.083761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031ce56-6b5f-462c-adbc-0c938e602519 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:05.084032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a031ce56-6b5f-462c-adbc-0c938e602519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:05.084852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031ce56-6b5f-462c-adbc-0c938e602519 None admin] RBAC: Adding query filter params (role.id=78cbd44006c3419d916364b7251b1ae4, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=ad52cba0b761482d96b6659654034ba6) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:05.085162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031ce56-6b5f-462c-adbc-0c938e602519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:05.087215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a031ce56-6b5f-462c-adbc-0c938e602519 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:05.093722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 616/1246] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:30:04 2022] GET /identity/v3/role_assignments?user.id=ad52cba0b761482d96b6659654034ba6&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=78cbd44006c3419d916364b7251b1ae4 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:30:07.279916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf8fd1-2f9e-4d87-9aee-5ef5565eedc4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:07.280445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf8fd1-2f9e-4d87-9aee-5ef5565eedc4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:07.280445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf8fd1-2f9e-4d87-9aee-5ef5565eedc4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:07.281755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 631/1247] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:07.287137 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdcbfd-eb10-4f6f-a177-add025bbb6a3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:07.287560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdcbfd-eb10-4f6f-a177-add025bbb6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:07.287682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdcbfd-eb10-4f6f-a177-add025bbb6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:07.294763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:07.308699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8fcdcbfd-eb10-4f6f-a177-add025bbb6a3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:07.309979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8fcdcbfd-eb10-4f6f-a177-add025bbb6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:07.384737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 617/1248] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:07.408536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf8fd1-2f9e-4d87-9aee-5ef5565eedc4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:07.427680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:07.523090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf8fd1-2f9e-4d87-9aee-5ef5565eedc4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:07.561665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea7c48-11b3-4036-b523-5b8fecfec6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:07.562373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea7c48-11b3-4036-b523-5b8fecfec6df None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:07.562691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea7c48-11b3-4036-b523-5b8fecfec6df None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:07.563026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea7c48-11b3-4036-b523-5b8fecfec6df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:07.574104 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea7c48-11b3-4036-b523-5b8fecfec6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-75ea7c48-11b3-4036-b523-5b8fecfec6df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:30:07.579376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:07.580729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:07.581937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 632/1249] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:30:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:07.587298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdcbfd-eb10-4f6f-a177-add025bbb6a3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:07.696606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdcbfd-eb10-4f6f-a177-add025bbb6a3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:07.729445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:07.735482 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70be3-ffde-4c9a-b1c2-88a4b6e6ccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:07.736177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70be3-ffde-4c9a-b1c2-88a4b6e6ccde None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:07.736465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70be3-ffde-4c9a-b1c2-88a4b6e6ccde None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:07.736755 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f70be3-ffde-4c9a-b1c2-88a4b6e6ccde None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:07.737547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70be3-ffde-4c9a-b1c2-88a4b6e6ccde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:07.737840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70be3-ffde-4c9a-b1c2-88a4b6e6ccde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:07.739269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f70be3-ffde-4c9a-b1c2-88a4b6e6ccde None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:07.749802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 618/1250] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:30:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:07.756170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea7c48-11b3-4036-b523-5b8fecfec6df None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:07.853068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:07.881593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea7c48-11b3-4036-b523-5b8fecfec6df None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:07.925890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ee365-5018-4dbf-9428-6352414e1cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:07.926592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ee365-5018-4dbf-9428-6352414e1cfa None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:07.926886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ee365-5018-4dbf-9428-6352414e1cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:07.927233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ee365-5018-4dbf-9428-6352414e1cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:07.938360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ee365-5018-4dbf-9428-6352414e1cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:07.940000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0ee365-5018-4dbf-9428-6352414e1cfa None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-fd0ee365-5018-4dbf-9428-6352414e1cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:07.955677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:07.956874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:07.957929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:07.957929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:07.957929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:07.957929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:07.957929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 633/1251] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:30:07.963668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70be3-ffde-4c9a-b1c2-88a4b6e6ccde None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:08.079643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f70be3-ffde-4c9a-b1c2-88a4b6e6ccde None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:08.117889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b900f-bf2a-4290-9f4e-3d520912e304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:08.118423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b900f-bf2a-4290-9f4e-3d520912e304 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:08.118705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b900f-bf2a-4290-9f4e-3d520912e304 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:08.118977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b900f-bf2a-4290-9f4e-3d520912e304 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:08.119662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b900f-bf2a-4290-9f4e-3d520912e304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:08.119964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b900f-bf2a-4290-9f4e-3d520912e304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:08.121360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b900f-bf2a-4290-9f4e-3d520912e304 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:08.134870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 619/1252] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:08.141272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ee365-5018-4dbf-9428-6352414e1cfa None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:08.257333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ee365-5018-4dbf-9428-6352414e1cfa None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:08.288947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:08.297592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f68cf-fbff-4c7a-a3c4-f9089bcd857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:08.298414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f68cf-fbff-4c7a-a3c4-f9089bcd857a None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:08.298699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f68cf-fbff-4c7a-a3c4-f9089bcd857a None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:08.298973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f68cf-fbff-4c7a-a3c4-f9089bcd857a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:08.307335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f68cf-fbff-4c7a-a3c4-f9089bcd857a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:08.308980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f68cf-fbff-4c7a-a3c4-f9089bcd857a None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-150f68cf-fbff-4c7a-a3c4-f9089bcd857a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:30:08.322002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:08.322926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:08.324251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 634/1253] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:08.329452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b900f-bf2a-4290-9f4e-3d520912e304 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:08.393751 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:08.449295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b900f-bf2a-4290-9f4e-3d520912e304 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:08.488881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9539a-486a-46d3-86a7-d942c90d0381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:08.489573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9539a-486a-46d3-86a7-d942c90d0381 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:08.489874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9539a-486a-46d3-86a7-d942c90d0381 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:08.490178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9539a-486a-46d3-86a7-d942c90d0381 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:08.491131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9539a-486a-46d3-86a7-d942c90d0381 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:08.491674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9539a-486a-46d3-86a7-d942c90d0381 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:08.494400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc9539a-486a-46d3-86a7-d942c90d0381 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:08.514664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 620/1254] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 21:30:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:08.520894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f68cf-fbff-4c7a-a3c4-f9089bcd857a None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:08.637470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f68cf-fbff-4c7a-a3c4-f9089bcd857a None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:08.675638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8de6-7cdc-4ad4-9fe0-fbe35686f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:08.676548 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8de6-7cdc-4ad4-9fe0-fbe35686f939 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:08.676889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8de6-7cdc-4ad4-9fe0-fbe35686f939 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:08.677167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e8de6-7cdc-4ad4-9fe0-fbe35686f939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:08.739584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:08.755542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e8de6-7cdc-4ad4-9fe0-fbe35686f939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:08.757095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e8de6-7cdc-4ad4-9fe0-fbe35686f939 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:08.872009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 635/1255] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:30:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:30:08.878106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9539a-486a-46d3-86a7-d942c90d0381 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:08.983733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9539a-486a-46d3-86a7-d942c90d0381 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:08.998428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:09.026236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7776a-5e5a-432d-aef9-82c739caad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:09.026883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7776a-5e5a-432d-aef9-82c739caad8b None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:09.027160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7776a-5e5a-432d-aef9-82c739caad8b None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:09.027427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7776a-5e5a-432d-aef9-82c739caad8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:09.038390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7776a-5e5a-432d-aef9-82c739caad8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:09.039983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c7776a-5e5a-432d-aef9-82c739caad8b None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-94c7776a-5e5a-432d-aef9-82c739caad8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:09.055682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:09.056903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:09.058189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:09.058189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:09.058189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:09.058189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:09.058189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 621/1256] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:09.063568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8de6-7cdc-4ad4-9fe0-fbe35686f939 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:09.158925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:09.171377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e8de6-7cdc-4ad4-9fe0-fbe35686f939 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:09.208690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e10bf-299e-4ef7-b0a5-be5026df0bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:09.209303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e10bf-299e-4ef7-b0a5-be5026df0bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:09.209584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e10bf-299e-4ef7-b0a5-be5026df0bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:09.209858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e10bf-299e-4ef7-b0a5-be5026df0bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:09.210552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e10bf-299e-4ef7-b0a5-be5026df0bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:09.210859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e10bf-299e-4ef7-b0a5-be5026df0bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:09.212421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e10bf-299e-4ef7-b0a5-be5026df0bf9 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:09.224506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 636/1257] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:09.230749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7776a-5e5a-432d-aef9-82c739caad8b None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:09.338731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c7776a-5e5a-432d-aef9-82c739caad8b None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:09.375169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dace0-69a1-4936-b729-984cf425d175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:09.375901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dace0-69a1-4936-b729-984cf425d175 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:09.376268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dace0-69a1-4936-b729-984cf425d175 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:09.376541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35dace0-69a1-4936-b729-984cf425d175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:09.384371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dace0-69a1-4936-b729-984cf425d175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:09.385952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35dace0-69a1-4936-b729-984cf425d175 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-b35dace0-69a1-4936-b729-984cf425d175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:30:09.397772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:09.398936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:09.400277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:30:09.400277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:30:09.400277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:30:09.400277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:30:09.400277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:30:09.400277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:30:09.400277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:09.400277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:09.400277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 622/1258] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:30:09.405280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e10bf-299e-4ef7-b0a5-be5026df0bf9 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:09.519501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e10bf-299e-4ef7-b0a5-be5026df0bf9 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:09.561885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85099c2-4c9c-4e25-9da9-b4cadf7a9f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:09.562542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85099c2-4c9c-4e25-9da9-b4cadf7a9f47 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:09.562925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85099c2-4c9c-4e25-9da9-b4cadf7a9f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:09.563295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85099c2-4c9c-4e25-9da9-b4cadf7a9f47 None admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:09.564285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85099c2-4c9c-4e25-9da9-b4cadf7a9f47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:09.564717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85099c2-4c9c-4e25-9da9-b4cadf7a9f47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:09.566531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85099c2-4c9c-4e25-9da9-b4cadf7a9f47 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:09.579982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 637/1259] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:09.586112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dace0-69a1-4936-b729-984cf425d175 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:09.613783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:09.695513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35dace0-69a1-4936-b729-984cf425d175 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:09.732349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94cd79-9658-479b-bdb4-34b1514169bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:09.733063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94cd79-9658-479b-bdb4-34b1514169bb None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:09.733326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94cd79-9658-479b-bdb4-34b1514169bb None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:09.733603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94cd79-9658-479b-bdb4-34b1514169bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:09.734481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94cd79-9658-479b-bdb4-34b1514169bb None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=ad52cba0b761482d96b6659654034ba6) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:09.734818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94cd79-9658-479b-bdb4-34b1514169bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:09.736362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94cd79-9658-479b-bdb4-34b1514169bb None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:09.741948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 623/1260] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:30:09 2022] GET /identity/v3/role_assignments?user.id=ad52cba0b761482d96b6659654034ba6&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:11.769293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ffe43-84d2-4fe9-900c-7babecbc02ba None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:11.769843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ffe43-84d2-4fe9-900c-7babecbc02ba None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:11.769843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ffe43-84d2-4fe9-900c-7babecbc02ba None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:11.771167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 638/1261] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:11.777130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269113a5-c4b1-4858-8a18-7640a371398a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:11.777544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269113a5-c4b1-4858-8a18-7640a371398a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:11.777689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269113a5-c4b1-4858-8a18-7640a371398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:11.795944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-269113a5-c4b1-4858-8a18-7640a371398a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:11.797175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-269113a5-c4b1-4858-8a18-7640a371398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:11.861439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 624/1262] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:11.884002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ffe43-84d2-4fe9-900c-7babecbc02ba None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:11.894519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:11.981895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ffe43-84d2-4fe9-900c-7babecbc02ba None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:12.014001 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8b259-64bd-440b-9bd3-8d1d39502cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:12.014622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8b259-64bd-440b-9bd3-8d1d39502cbb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:12.014899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8b259-64bd-440b-9bd3-8d1d39502cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:12.015170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8b259-64bd-440b-9bd3-8d1d39502cbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:12.025696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f8b259-64bd-440b-9bd3-8d1d39502cbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-85f8b259-64bd-440b-9bd3-8d1d39502cbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:30:12.030528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:12.031616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:12.032626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 639/1263] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:12.037644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269113a5-c4b1-4858-8a18-7640a371398a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:12.055368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:12.134815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269113a5-c4b1-4858-8a18-7640a371398a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:12.167676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e0e16-0000-4479-be1a-b5c9f3890289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:12.168314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e0e16-0000-4479-be1a-b5c9f3890289 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:12.168619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e0e16-0000-4479-be1a-b5c9f3890289 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:12.168891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e0e16-0000-4479-be1a-b5c9f3890289 None admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:12.169593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e0e16-0000-4479-be1a-b5c9f3890289 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:12.169893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e0e16-0000-4479-be1a-b5c9f3890289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:12.171235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e0e16-0000-4479-be1a-b5c9f3890289 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:12.178915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 625/1264] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:30:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:12.185000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8b259-64bd-440b-9bd3-8d1d39502cbb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:12.249031 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:12.281357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8b259-64bd-440b-9bd3-8d1d39502cbb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:12.314078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cb6ff-a5cc-42c1-9c2f-669532230442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:12.314694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb6ff-a5cc-42c1-9c2f-669532230442 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:12.314974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb6ff-a5cc-42c1-9c2f-669532230442 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:12.315241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0cb6ff-a5cc-42c1-9c2f-669532230442 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:12.325322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cb6ff-a5cc-42c1-9c2f-669532230442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:12.326754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0cb6ff-a5cc-42c1-9c2f-669532230442 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4c0cb6ff-a5cc-42c1-9c2f-669532230442 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:12.340776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:12.341775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:12.342682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:12.342682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:12.342682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:12.342682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:12.342682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 640/1265] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:12.347499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e0e16-0000-4479-be1a-b5c9f3890289 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:12.425842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:12.446000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e0e16-0000-4479-be1a-b5c9f3890289 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:12.478203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808666e-0d61-4a49-ab00-a0fb8b4cd4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:12.478802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808666e-0d61-4a49-ab00-a0fb8b4cd4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:12.479086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808666e-0d61-4a49-ab00-a0fb8b4cd4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:12.479363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808666e-0d61-4a49-ab00-a0fb8b4cd4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:12.480046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808666e-0d61-4a49-ab00-a0fb8b4cd4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:12.480383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808666e-0d61-4a49-ab00-a0fb8b4cd4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:12.481730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808666e-0d61-4a49-ab00-a0fb8b4cd4e4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:12.494728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 626/1266] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:12.501708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cb6ff-a5cc-42c1-9c2f-669532230442 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:12.610755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0cb6ff-a5cc-42c1-9c2f-669532230442 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:12.629798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:12.643410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba19529-4fc3-4a2a-bf51-464c463f80e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:12.644385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba19529-4fc3-4a2a-bf51-464c463f80e6 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:12.644847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba19529-4fc3-4a2a-bf51-464c463f80e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:12.645336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba19529-4fc3-4a2a-bf51-464c463f80e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:12.656333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba19529-4fc3-4a2a-bf51-464c463f80e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:12.657771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba19529-4fc3-4a2a-bf51-464c463f80e6 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-7ba19529-4fc3-4a2a-bf51-464c463f80e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:30:12.669127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:12.670218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:12.671358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 641/1267] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:12.676169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808666e-0d61-4a49-ab00-a0fb8b4cd4e4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:12.771666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808666e-0d61-4a49-ab00-a0fb8b4cd4e4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:12.805862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21178947-033a-44bd-b32e-8986481fbc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:12.806471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21178947-033a-44bd-b32e-8986481fbc43 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:12.806746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21178947-033a-44bd-b32e-8986481fbc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:12.807014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21178947-033a-44bd-b32e-8986481fbc43 None admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:12.807787 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21178947-033a-44bd-b32e-8986481fbc43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:12.808085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21178947-033a-44bd-b32e-8986481fbc43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:12.809521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21178947-033a-44bd-b32e-8986481fbc43 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:12.818027 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:12.826748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 627/1268] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 21:30:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:12.832419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba19529-4fc3-4a2a-bf51-464c463f80e6 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:12.929472 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba19529-4fc3-4a2a-bf51-464c463f80e6 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:12.961732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12740efb-658b-46e9-9cdc-174c27491432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:12.962353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12740efb-658b-46e9-9cdc-174c27491432 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:12.962633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12740efb-658b-46e9-9cdc-174c27491432 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:12.962902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12740efb-658b-46e9-9cdc-174c27491432 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:12.973023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12740efb-658b-46e9-9cdc-174c27491432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:12.974464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12740efb-658b-46e9-9cdc-174c27491432 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-12740efb-658b-46e9-9cdc-174c27491432 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:12.989058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:12.990070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:12.991067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:12.991067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:12.991067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:12.991067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:12.991067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 642/1269] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:12.995815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21178947-033a-44bd-b32e-8986481fbc43 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:13.091775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21178947-033a-44bd-b32e-8986481fbc43 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:13.124201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f66507-6408-40c1-885a-7eebe63e4703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:13.124802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f66507-6408-40c1-885a-7eebe63e4703 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:13.125082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f66507-6408-40c1-885a-7eebe63e4703 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:13.125355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f66507-6408-40c1-885a-7eebe63e4703 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:13.126036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f66507-6408-40c1-885a-7eebe63e4703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:13.126338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f66507-6408-40c1-885a-7eebe63e4703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:13.127676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f66507-6408-40c1-885a-7eebe63e4703 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:13.138486 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 628/1270] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:13.143913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12740efb-658b-46e9-9cdc-174c27491432 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:13.175365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:13.240976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12740efb-658b-46e9-9cdc-174c27491432 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:13.272960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba75f9-b852-47c1-b03b-7daaa60b97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:13.274158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba75f9-b852-47c1-b03b-7daaa60b97fb None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:13.274682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba75f9-b852-47c1-b03b-7daaa60b97fb None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:13.274963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba75f9-b852-47c1-b03b-7daaa60b97fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:13.281369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba75f9-b852-47c1-b03b-7daaa60b97fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:13.282801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba75f9-b852-47c1-b03b-7daaa60b97fb None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-5aba75f9-b852-47c1-b03b-7daaa60b97fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:30:13.293837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:13.294819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:13.295789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:30:13.295789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:30:13.295789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:30:13.295789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:30:13.295789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:30:13.295789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:30:13.295789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:13.295789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:13.295789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 643/1271] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:13.300629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f66507-6408-40c1-885a-7eebe63e4703 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:13.356930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:13.396658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f66507-6408-40c1-885a-7eebe63e4703 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:13.428788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17380519-0fae-4b08-9815-127521bb24d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:13.429386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380519-0fae-4b08-9815-127521bb24d3 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:13.429692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380519-0fae-4b08-9815-127521bb24d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:13.429968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17380519-0fae-4b08-9815-127521bb24d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:13.430698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380519-0fae-4b08-9815-127521bb24d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:13.431003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380519-0fae-4b08-9815-127521bb24d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:13.432439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17380519-0fae-4b08-9815-127521bb24d3 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:13.443810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 629/1272] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:13.450046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba75f9-b852-47c1-b03b-7daaa60b97fb None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:13.547600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:13.556910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba75f9-b852-47c1-b03b-7daaa60b97fb None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:13.589619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434fada-c263-453b-b466-6ae530748df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:13.590275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434fada-c263-453b-b466-6ae530748df3 None admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:13.590560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434fada-c263-453b-b466-6ae530748df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:13.590838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434fada-c263-453b-b466-6ae530748df3 None admin] PATH_INFO: `/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/ad52cba0b761482d96b6659654034ba6/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:13.592772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434fada-c263-453b-b466-6ae530748df3 None admin] RBAC: Authorizing `identity:create_grant(project_id=21fa5a0ae53c48b2a468a2de5aec5148, user_id=ad52cba0b761482d96b6659654034ba6, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:13.594242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434fada-c263-453b-b466-6ae530748df3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:13.607804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 644/1273] 10.222.0.57 () {58 vars in 1439 bytes} [Tue Aug 2 21:30:13 2022] PUT /identity/v3/projects/21fa5a0ae53c48b2a468a2de5aec5148/users/ad52cba0b761482d96b6659654034ba6/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:30:15.566532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846e845-c803-4988-bafc-ebc7e9e09c12 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:15.567054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846e845-c803-4988-bafc-ebc7e9e09c12 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:15.567054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846e845-c803-4988-bafc-ebc7e9e09c12 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:15.568460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 630/1274] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:15.573578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16885893-3165-4c76-9361-7c3e93265176 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:15.573947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16885893-3165-4c76-9361-7c3e93265176 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:15.574127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16885893-3165-4c76-9361-7c3e93265176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:15.592108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-16885893-3165-4c76-9361-7c3e93265176 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:15.593309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-16885893-3165-4c76-9361-7c3e93265176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:15.659363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 645/1275] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:15.683366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846e845-c803-4988-bafc-ebc7e9e09c12 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:15.780274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846e845-c803-4988-bafc-ebc7e9e09c12 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:15.798758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:15.815986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fdca0-b479-46f4-994d-df94a4a6920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:15.816699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fdca0-b479-46f4-994d-df94a4a6920d None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:15.816929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fdca0-b479-46f4-994d-df94a4a6920d None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:15.817197 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fdca0-b479-46f4-994d-df94a4a6920d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:15.826978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2fdca0-b479-46f4-994d-df94a4a6920d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-ad2fdca0-b479-46f4-994d-df94a4a6920d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:30:15.831848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:15.832922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:15.833808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 631/1276] 10.222.0.57 () {56 vars in 1096 bytes} [Tue Aug 2 21:30:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:15.839443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16885893-3165-4c76-9361-7c3e93265176 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:15.917446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:15.936085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16885893-3165-4c76-9361-7c3e93265176 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:15.968116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0bfc6-d5ac-45cb-8eb7-f2d5088f5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:15.968752 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0bfc6-d5ac-45cb-8eb7-f2d5088f5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:15.969035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0bfc6-d5ac-45cb-8eb7-f2d5088f5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:15.969307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0bfc6-d5ac-45cb-8eb7-f2d5088f5ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:15.970007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0bfc6-d5ac-45cb-8eb7-f2d5088f5ec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:15.970308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0bfc6-d5ac-45cb-8eb7-f2d5088f5ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:15.971663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0bfc6-d5ac-45cb-8eb7-f2d5088f5ec3 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:15.979835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 646/1277] 10.222.0.57 () {56 vars in 1099 bytes} [Tue Aug 2 21:30:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:15.985312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fdca0-b479-46f4-994d-df94a4a6920d None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:16.081134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fdca0-b479-46f4-994d-df94a4a6920d None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:16.115092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898365e5-e2e0-4e26-b89c-fc3d9b21df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:16.115718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898365e5-e2e0-4e26-b89c-fc3d9b21df73 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:16.115997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898365e5-e2e0-4e26-b89c-fc3d9b21df73 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:16.116303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898365e5-e2e0-4e26-b89c-fc3d9b21df73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:16.126580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898365e5-e2e0-4e26-b89c-fc3d9b21df73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:16.128008 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898365e5-e2e0-4e26-b89c-fc3d9b21df73 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-898365e5-e2e0-4e26-b89c-fc3d9b21df73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:16.141744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:16.142771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:16.143682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:16.143682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:16.143682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:16.143682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:16.143682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 632/1278] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:16.149145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0bfc6-d5ac-45cb-8eb7-f2d5088f5ec3 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:16.244406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0bfc6-d5ac-45cb-8eb7-f2d5088f5ec3 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:16.277096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76bef-1d32-4862-a8bd-43c72d5358e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:16.277695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76bef-1d32-4862-a8bd-43c72d5358e5 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:16.277974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76bef-1d32-4862-a8bd-43c72d5358e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:16.278247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76bef-1d32-4862-a8bd-43c72d5358e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:16.278930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e76bef-1d32-4862-a8bd-43c72d5358e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:16.279229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e76bef-1d32-4862-a8bd-43c72d5358e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:16.280627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e76bef-1d32-4862-a8bd-43c72d5358e5 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:16.291755 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 647/1279] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:16.297250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898365e5-e2e0-4e26-b89c-fc3d9b21df73 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:16.327557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:16.395015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898365e5-e2e0-4e26-b89c-fc3d9b21df73 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:16.427977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ee9aa-0b70-400e-8f70-514f2db04f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:16.428614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ee9aa-0b70-400e-8f70-514f2db04f12 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:16.428895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ee9aa-0b70-400e-8f70-514f2db04f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:16.429167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ee9aa-0b70-400e-8f70-514f2db04f12 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:16.436344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ee9aa-0b70-400e-8f70-514f2db04f12 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:16.437771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ee9aa-0b70-400e-8f70-514f2db04f12 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-699ee9aa-0b70-400e-8f70-514f2db04f12 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:30:16.449210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:16.450301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:16.451705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 633/1280] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:16.455927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76bef-1d32-4862-a8bd-43c72d5358e5 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:16.459590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:16.559841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76bef-1d32-4862-a8bd-43c72d5358e5 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:16.592397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c384be2-a1c6-4938-9417-3ece1c818601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:16.592995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c384be2-a1c6-4938-9417-3ece1c818601 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:16.593262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c384be2-a1c6-4938-9417-3ece1c818601 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:16.593528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c384be2-a1c6-4938-9417-3ece1c818601 None admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:16.594302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c384be2-a1c6-4938-9417-3ece1c818601 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:16.594602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c384be2-a1c6-4938-9417-3ece1c818601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:16.596010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c384be2-a1c6-4938-9417-3ece1c818601 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:16.612047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 648/1281] 10.222.0.57 () {56 vars in 1143 bytes} [Tue Aug 2 21:30:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:16.618342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ee9aa-0b70-400e-8f70-514f2db04f12 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:16.706381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:16.715875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ee9aa-0b70-400e-8f70-514f2db04f12 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:16.748000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fd717-a5c1-4b08-a6a7-5ccf1a81e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:16.748617 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fd717-a5c1-4b08-a6a7-5ccf1a81e669 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:16.748894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fd717-a5c1-4b08-a6a7-5ccf1a81e669 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:16.749156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fd717-a5c1-4b08-a6a7-5ccf1a81e669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:16.826539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fd717-a5c1-4b08-a6a7-5ccf1a81e669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:16.827985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fd717-a5c1-4b08-a6a7-5ccf1a81e669 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:16.912999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:16.923317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 634/1282] 10.222.0.57 () {58 vars in 1282 bytes} [Tue Aug 2 21:30:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:30:16.929200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c384be2-a1c6-4938-9417-3ece1c818601 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:16.988418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:17.025437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c384be2-a1c6-4938-9417-3ece1c818601 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:17.059220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849dbdd-7766-46ca-96ae-8d9da8ecf527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:17.059847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dbdd-7766-46ca-96ae-8d9da8ecf527 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:17.060127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dbdd-7766-46ca-96ae-8d9da8ecf527 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:17.060428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849dbdd-7766-46ca-96ae-8d9da8ecf527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:17.069980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849dbdd-7766-46ca-96ae-8d9da8ecf527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:17.071412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849dbdd-7766-46ca-96ae-8d9da8ecf527 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-3849dbdd-7766-46ca-96ae-8d9da8ecf527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:17.085475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:17.086596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:17.087766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:17.087766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:17.087766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:17.087766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:17.087766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 649/1283] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:30:17.094029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fd717-a5c1-4b08-a6a7-5ccf1a81e669 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:17.195638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fd717-a5c1-4b08-a6a7-5ccf1a81e669 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:17.228353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710152c-7423-45d2-960b-874a8befe6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:17.228958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710152c-7423-45d2-960b-874a8befe6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:17.229239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710152c-7423-45d2-960b-874a8befe6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:17.229513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710152c-7423-45d2-960b-874a8befe6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:17.230189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710152c-7423-45d2-960b-874a8befe6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:17.230491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710152c-7423-45d2-960b-874a8befe6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:17.231839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710152c-7423-45d2-960b-874a8befe6d0 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:17.243311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 635/1284] 10.222.0.57 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:17.249020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849dbdd-7766-46ca-96ae-8d9da8ecf527 None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:17.345415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849dbdd-7766-46ca-96ae-8d9da8ecf527 None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:17.358963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:17.378633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4128c8-380e-4794-9ac2-9746adbdbbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:17.379252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4128c8-380e-4794-9ac2-9746adbdbbce None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:17.379543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4128c8-380e-4794-9ac2-9746adbdbbce None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:17.379818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4128c8-380e-4794-9ac2-9746adbdbbce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:17.386285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4128c8-380e-4794-9ac2-9746adbdbbce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:17.387720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4128c8-380e-4794-9ac2-9746adbdbbce None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application [None req-4c4128c8-380e-4794-9ac2-9746adbdbbce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:30:17.399572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:17.400597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:17.401860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:30:17.401860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:30:17.401860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:30:17.401860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:30:17.401860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:30:17.401860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:30:17.401860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:17.401860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: ERROR keystone.server.flask.application Aug 02 21:30:17.401860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 650/1285] 10.222.0.57 () {56 vars in 1111 bytes} [Tue Aug 2 21:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:17.406461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710152c-7423-45d2-960b-874a8befe6d0 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:17.454844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:17.511302 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710152c-7423-45d2-960b-874a8befe6d0 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:17.545755 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd47ca-25e9-4650-b351-fafe7d244b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:17.546356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd47ca-25e9-4650-b351-fafe7d244b2c None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:17.546632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd47ca-25e9-4650-b351-fafe7d244b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:17.546898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd47ca-25e9-4650-b351-fafe7d244b2c None admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:17.547627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd47ca-25e9-4650-b351-fafe7d244b2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:17.547926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd47ca-25e9-4650-b351-fafe7d244b2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:17.549372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd47ca-25e9-4650-b351-fafe7d244b2c None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:17.561048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 636/1286] 10.222.0.57 () {56 vars in 1148 bytes} [Tue Aug 2 21:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:17.567125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4128c8-380e-4794-9ac2-9746adbdbbce None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:17.662779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4128c8-380e-4794-9ac2-9746adbdbbce None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:17.697765 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a3ad4-ca93-4159-98af-cf7b895ceb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:17.698369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a3ad4-ca93-4159-98af-cf7b895ceb65 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:17.698660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a3ad4-ca93-4159-98af-cf7b895ceb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:17.698932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a3ad4-ca93-4159-98af-cf7b895ceb65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:17.699714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a3ad4-ca93-4159-98af-cf7b895ceb65 None admin] RBAC: Adding query filter params (role.id=ecc5b2701c504f1a96322b36e39b231a, scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148, user.id=ad52cba0b761482d96b6659654034ba6) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:17.700023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a3ad4-ca93-4159-98af-cf7b895ceb65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:17.701477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a3ad4-ca93-4159-98af-cf7b895ceb65 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:17.707059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 651/1287] 10.222.0.57 () {56 vars in 1374 bytes} [Tue Aug 2 21:30:17 2022] GET /identity/v3/role_assignments?user.id=ad52cba0b761482d96b6659654034ba6&scope.project.id=21fa5a0ae53c48b2a468a2de5aec5148&role.id=ecc5b2701c504f1a96322b36e39b231a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:19.756172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19584413-d61c-4171-a130-45e42ea07b00 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:19.756714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19584413-d61c-4171-a130-45e42ea07b00 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:19.756714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19584413-d61c-4171-a130-45e42ea07b00 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:19.758070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 637/1288] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:19.763022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c2a5-368d-48c3-9d07-e90dc3c18dad None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:19.763454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c2a5-368d-48c3-9d07-e90dc3c18dad None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:19.763585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230c2a5-368d-48c3-9d07-e90dc3c18dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:19.781903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2230c2a5-368d-48c3-9d07-e90dc3c18dad None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:19.783079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2230c2a5-368d-48c3-9d07-e90dc3c18dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:19.813210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:19.849706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 652/1289] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:19.871854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19584413-d61c-4171-a130-45e42ea07b00 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:19.973710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19584413-d61c-4171-a130-45e42ea07b00 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:19.984540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:20.007737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a39dd-dc3f-4495-979c-dec5f8b201be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:20.008329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a39dd-dc3f-4495-979c-dec5f8b201be None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:20.008610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a39dd-dc3f-4495-979c-dec5f8b201be None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:20.008880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a39dd-dc3f-4495-979c-dec5f8b201be None admin] PATH_INFO: `/v3/services/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:20.009526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a39dd-dc3f-4495-979c-dec5f8b201be None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:20.010873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a39dd-dc3f-4495-979c-dec5f8b201be None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-cc7a39dd-dc3f-4495-979c-dec5f8b201be None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:20.019490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:20.020704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:20.021888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 638/1290] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:30:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:20.027343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c2a5-368d-48c3-9d07-e90dc3c18dad None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:20.122301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230c2a5-368d-48c3-9d07-e90dc3c18dad None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:20.155237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd491-cd97-4c3d-b242-16c58b14ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:20.155840 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd491-cd97-4c3d-b242-16c58b14ac4c None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:20.156116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd491-cd97-4c3d-b242-16c58b14ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:20.156415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd491-cd97-4c3d-b242-16c58b14ac4c None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:20.157081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd491-cd97-4c3d-b242-16c58b14ac4c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:20.157391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd491-cd97-4c3d-b242-16c58b14ac4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:20.158727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd491-cd97-4c3d-b242-16c58b14ac4c None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:20.163326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 653/1291] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 2 21:30:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:20.169055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a39dd-dc3f-4495-979c-dec5f8b201be None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:20.264906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a39dd-dc3f-4495-979c-dec5f8b201be None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:20.297041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a41a4-6682-4814-9676-43c8c234e6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:20.297634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a41a4-6682-4814-9676-43c8c234e6dd None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:20.297916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a41a4-6682-4814-9676-43c8c234e6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:20.298190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a41a4-6682-4814-9676-43c8c234e6dd None admin] PATH_INFO: `/v3/services` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:20.298850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a41a4-6682-4814-9676-43c8c234e6dd None admin] RBAC: Adding query filter params (type=placement) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:20.299152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a41a4-6682-4814-9676-43c8c234e6dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:20.300524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a41a4-6682-4814-9676-43c8c234e6dd None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:20.304770 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 639/1292] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 2 21:30:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:22.304445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea88a8e-7c30-4232-bf97-6d0c9acc44e2 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:22.304969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea88a8e-7c30-4232-bf97-6d0c9acc44e2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:22.304969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea88a8e-7c30-4232-bf97-6d0c9acc44e2 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:22.306313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 654/1293] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:22.311530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f726cb-bcaa-4682-8c6d-e63a163912de None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:22.311893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f726cb-bcaa-4682-8c6d-e63a163912de None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:22.312076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f726cb-bcaa-4682-8c6d-e63a163912de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:22.330222 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a4f726cb-bcaa-4682-8c6d-e63a163912de None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:22.331395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a4f726cb-bcaa-4682-8c6d-e63a163912de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:22.360059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:22.395952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 640/1294] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:22.418804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea88a8e-7c30-4232-bf97-6d0c9acc44e2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:22.448942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:22.529340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea88a8e-7c30-4232-bf97-6d0c9acc44e2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:22.572160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ba6df-055d-4505-9ad3-896c9a9b5dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:22.572815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba6df-055d-4505-9ad3-896c9a9b5dbc None admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:22.573127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba6df-055d-4505-9ad3-896c9a9b5dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:22.573468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ba6df-055d-4505-9ad3-896c9a9b5dbc None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:22.574386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ba6df-055d-4505-9ad3-896c9a9b5dbc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:22.576071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ba6df-055d-4505-9ad3-896c9a9b5dbc None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:22.590970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 655/1295] 10.222.0.57 () {60 vars in 1141 bytes} [Tue Aug 2 21:30:22 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:30:24.585346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2d073-9cff-456b-aac6-a357134c3970 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:24.585934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2d073-9cff-456b-aac6-a357134c3970 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:24.585934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2d073-9cff-456b-aac6-a357134c3970 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:24.587243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 641/1296] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:24.592259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f1125-57b5-4760-9e0f-2abac8e374e4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:24.592658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f1125-57b5-4760-9e0f-2abac8e374e4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:24.592815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f1125-57b5-4760-9e0f-2abac8e374e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:24.610846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-610f1125-57b5-4760-9e0f-2abac8e374e4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:24.612037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-610f1125-57b5-4760-9e0f-2abac8e374e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:24.682863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 656/1297] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:24.704982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2d073-9cff-456b-aac6-a357134c3970 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:24.804940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2d073-9cff-456b-aac6-a357134c3970 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:24.837965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045d80b-18cd-4c7f-bc36-cdffca733cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:24.838531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045d80b-18cd-4c7f-bc36-cdffca733cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:24.838809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045d80b-18cd-4c7f-bc36-cdffca733cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:24.839081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045d80b-18cd-4c7f-bc36-cdffca733cc4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:24.839701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045d80b-18cd-4c7f-bc36-cdffca733cc4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:24.841086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045d80b-18cd-4c7f-bc36-cdffca733cc4 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-c045d80b-18cd-4c7f-bc36-cdffca733cc4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:24.849644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:24.851435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:24.852648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 642/1298] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:30:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:24.857463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f1125-57b5-4760-9e0f-2abac8e374e4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:24.875084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:24.953027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f1125-57b5-4760-9e0f-2abac8e374e4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:24.985816 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a81b-6038-477e-97d7-5aa033f13e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:24.986424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a81b-6038-477e-97d7-5aa033f13e9e None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:24.986729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a81b-6038-477e-97d7-5aa033f13e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:24.987003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8a81b-6038-477e-97d7-5aa033f13e9e None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:24.987698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8a81b-6038-477e-97d7-5aa033f13e9e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:24.988060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8a81b-6038-477e-97d7-5aa033f13e9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:24.989479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8a81b-6038-477e-97d7-5aa033f13e9e None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:24.994445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 657/1299] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 2 21:30:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:25.000236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045d80b-18cd-4c7f-bc36-cdffca733cc4 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:25.031206 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:25.097459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045d80b-18cd-4c7f-bc36-cdffca733cc4 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:25.129282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c02d22-875c-4eab-8390-127d72e28db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:25.129878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c02d22-875c-4eab-8390-127d72e28db1 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:25.130154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c02d22-875c-4eab-8390-127d72e28db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:25.130424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c02d22-875c-4eab-8390-127d72e28db1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:25.131163 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c02d22-875c-4eab-8390-127d72e28db1 None admin] RBAC: Adding query filter params (interface=public, service_id=00b5c7db05684640bda1cc089299fa2f, region_id=RegionOne) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:25.131472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c02d22-875c-4eab-8390-127d72e28db1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:25.132884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c02d22-875c-4eab-8390-127d72e28db1 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:25.137693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 643/1300] 10.222.0.57 () {56 vars in 1251 bytes} [Tue Aug 2 21:30:24 2022] GET /identity/v3/endpoints?service_id=00b5c7db05684640bda1cc089299fa2f&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:25.143256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a81b-6038-477e-97d7-5aa033f13e9e None admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:25.222617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:25.240517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8a81b-6038-477e-97d7-5aa033f13e9e None admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:25.273661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75c709-086b-465e-8d3c-572027506e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:25.274529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75c709-086b-465e-8d3c-572027506e0d None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:25.274806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75c709-086b-465e-8d3c-572027506e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:25.275073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75c709-086b-465e-8d3c-572027506e0d None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:25.275717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75c709-086b-465e-8d3c-572027506e0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:25.277091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b75c709-086b-465e-8d3c-572027506e0d None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:25.283560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 658/1301] 10.222.0.57 () {56 vars in 1087 bytes} [Tue Aug 2 21:30:25 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:30:27.239472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ed9a-118e-48cb-a04d-bec05fc7976b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:27.239967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ed9a-118e-48cb-a04d-bec05fc7976b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:27.239967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5ed9a-118e-48cb-a04d-bec05fc7976b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:27.241848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 644/1302] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:27.246836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6557b-21ee-451f-8c79-14ad4da9fdd5 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:27.247211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6557b-21ee-451f-8c79-14ad4da9fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:27.247394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6557b-21ee-451f-8c79-14ad4da9fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:27.265562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0ac6557b-21ee-451f-8c79-14ad4da9fdd5 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:27.266740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0ac6557b-21ee-451f-8c79-14ad4da9fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:27.330694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 659/1303] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:27.352109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5ed9a-118e-48cb-a04d-bec05fc7976b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:27.443019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:27.450338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5ed9a-118e-48cb-a04d-bec05fc7976b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:27.482283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee89f79-d79e-4cfe-8d97-033fb3d22409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:27.482901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89f79-d79e-4cfe-8d97-033fb3d22409 None admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:27.483179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89f79-d79e-4cfe-8d97-033fb3d22409 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:27.483448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee89f79-d79e-4cfe-8d97-033fb3d22409 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:27.484062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee89f79-d79e-4cfe-8d97-033fb3d22409 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:27.485458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee89f79-d79e-4cfe-8d97-033fb3d22409 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application [None req-aee89f79-d79e-4cfe-8d97-033fb3d22409 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:27.495076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:27.496454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: ERROR keystone.server.flask.application Aug 02 21:30:27.497570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 645/1304] 10.222.0.57 () {56 vars in 1117 bytes} [Tue Aug 2 21:30:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:27.502555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6557b-21ee-451f-8c79-14ad4da9fdd5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:27.582923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:27.605526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6557b-21ee-451f-8c79-14ad4da9fdd5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:27.637601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b893-f0b2-4925-af47-dee0855290e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:27.638204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b893-f0b2-4925-af47-dee0855290e8 None admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:27.638481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b893-f0b2-4925-af47-dee0855290e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:27.638749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b893-f0b2-4925-af47-dee0855290e8 None admin] PATH_INFO: `/v3/services` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:27.639414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84b893-f0b2-4925-af47-dee0855290e8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:27.639713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84b893-f0b2-4925-af47-dee0855290e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:27.641094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84b893-f0b2-4925-af47-dee0855290e8 None admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:27.645982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 660/1305] 10.222.0.57 () {56 vars in 1116 bytes} [Tue Aug 2 21:30:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:27.652007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee89f79-d79e-4cfe-8d97-033fb3d22409 None admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:27.748951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee89f79-d79e-4cfe-8d97-033fb3d22409 None admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:27.781002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36657c-929c-4682-983a-917c9426ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:27.781605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36657c-929c-4682-983a-917c9426ae74 None admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:27.781885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36657c-929c-4682-983a-917c9426ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:27.782158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36657c-929c-4682-983a-917c9426ae74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:27.782872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36657c-929c-4682-983a-917c9426ae74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:27.784243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a36657c-929c-4682-983a-917c9426ae74 None admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:27.807586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 646/1306] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:30:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:30:37.643053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=30 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:37.802911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:30.706513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8716b-a746-4808-a3e2-dbd4492b2702 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:30.707096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8716b-a746-4808-a3e2-dbd4492b2702 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:30.707096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8716b-a746-4808-a3e2-dbd4492b2702 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:30.713940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016179f-9c21-4fa9-b180-57cd2c20ad9d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:30.714418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016179f-9c21-4fa9-b180-57cd2c20ad9d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:30.714513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016179f-9c21-4fa9-b180-57cd2c20ad9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:30.717161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 661/1307] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:30.800438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7016179f-9c21-4fa9-b180-57cd2c20ad9d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:30.801718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7016179f-9c21-4fa9-b180-57cd2c20ad9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:30.911758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 647/1308] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:31:30.961097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842301e-18d2-4dd8-b6a7-e478f60cf1b1 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:30.961470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842301e-18d2-4dd8-b6a7-e478f60cf1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:30.961639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2842301e-18d2-4dd8-b6a7-e478f60cf1b1 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:30.963038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 662/1309] 10.222.0.57 () {54 vars in 965 bytes} [Tue Aug 2 21:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:30.970734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cedfa-60e1-4720-9177-9a82da994d6c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:30.971613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cedfa-60e1-4720-9177-9a82da994d6c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:30.971960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2cedfa-60e1-4720-9177-9a82da994d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:31.058666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ff2cedfa-60e1-4720-9177-9a82da994d6c None None] MFA Rules not processed for user `24644cede7e149a6b3e5bd39b930017b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:31.059867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ff2cedfa-60e1-4720-9177-9a82da994d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:31.081115 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:31.138819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 648/1310] 10.222.0.57 () {58 vars in 1062 bytes} [Tue Aug 2 21:31:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:31:31.148682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842301e-18d2-4dd8-b6a7-e478f60cf1b1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:31.150483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2842301e-18d2-4dd8-b6a7-e478f60cf1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:31.264302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2842301e-18d2-4dd8-b6a7-e478f60cf1b1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:31.339183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa59c1-779f-4b7e-ae89-eba324874505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:31.339800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa59c1-779f-4b7e-ae89-eba324874505 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:31.340076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa59c1-779f-4b7e-ae89-eba324874505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:31.340373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa59c1-779f-4b7e-ae89-eba324874505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:31.341997 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f8fa59c1-779f-4b7e-ae89-eba324874505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:31.397339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:31.469981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa59c1-779f-4b7e-ae89-eba324874505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:31.471453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa59c1-779f-4b7e-ae89-eba324874505 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:31.492208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 663/1311] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:31:33.831532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d2016-f616-46a4-863b-8f02e122a8b1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:33.832043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d2016-f616-46a4-863b-8f02e122a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:33.832122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d2016-f616-46a4-863b-8f02e122a8b1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:33.833627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 649/1312] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:31:33.838594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b25cf-87f0-4268-a25d-927e14549489 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:33.839002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b25cf-87f0-4268-a25d-927e14549489 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:33.839209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b25cf-87f0-4268-a25d-927e14549489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:33.911380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7d1b25cf-87f0-4268-a25d-927e14549489 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:33.912616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7d1b25cf-87f0-4268-a25d-927e14549489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:34.014087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 664/1313] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:31:34.052572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d2016-f616-46a4-863b-8f02e122a8b1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:34.054327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ac1d2016-f616-46a4-863b-8f02e122a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:34.176055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d2016-f616-46a4-863b-8f02e122a8b1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:34.266555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:34.269532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b69a5b-50d3-4229-b18f-ddffd829f3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:34.270607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69a5b-50d3-4229-b18f-ddffd829f3fa service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:34.271290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69a5b-50d3-4229-b18f-ddffd829f3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:34.272234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69a5b-50d3-4229-b18f-ddffd829f3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:34.274524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-12b69a5b-50d3-4229-b18f-ddffd829f3fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:34.397664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b69a5b-50d3-4229-b18f-ddffd829f3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:34.399102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b69a5b-50d3-4229-b18f-ddffd829f3fa service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:34.417997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 650/1314] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:31:36.741715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5461525-22ce-4769-ab8a-ca4ddd8967be None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:36.742317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5461525-22ce-4769-ab8a-ca4ddd8967be None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:36.742317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5461525-22ce-4769-ab8a-ca4ddd8967be None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:36.743613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 665/1315] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:36.749794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0061000-c00b-4b44-abd0-e592dd1c1192 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:36.750247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0061000-c00b-4b44-abd0-e592dd1c1192 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:36.750348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0061000-c00b-4b44-abd0-e592dd1c1192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:36.815587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f0061000-c00b-4b44-abd0-e592dd1c1192 None None] MFA Rules not processed for user `c3a3b12c08684d71aa48c75435606f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:36.816810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f0061000-c00b-4b44-abd0-e592dd1c1192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:36.867152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:36.911093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 651/1316] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:31:36.949923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5461525-22ce-4769-ab8a-ca4ddd8967be None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:36.951472 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b5461525-22ce-4769-ab8a-ca4ddd8967be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:36.961537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:37.054052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5461525-22ce-4769-ab8a-ca4ddd8967be None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:37.124215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7cc6a0-a654-4158-be45-04b91171ecc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:37.124778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc6a0-a654-4158-be45-04b91171ecc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:37.125056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc6a0-a654-4158-be45-04b91171ecc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:37.125328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7cc6a0-a654-4158-be45-04b91171ecc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:37.126981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8c7cc6a0-a654-4158-be45-04b91171ecc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:37.186539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:37.231918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc6a0-a654-4158-be45-04b91171ecc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:37.233389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7cc6a0-a654-4158-be45-04b91171ecc7 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:37.250666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 666/1317] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:31:39.791861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf27d-a6a0-42da-bc69-8c34fc31fbcd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:39.792465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf27d-a6a0-42da-bc69-8c34fc31fbcd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:39.792465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cf27d-a6a0-42da-bc69-8c34fc31fbcd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:39.793820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 652/1318] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:39.799581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4db8-e674-4b20-a207-dd07de7fc01d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:39.800023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4db8-e674-4b20-a207-dd07de7fc01d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:39.800446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e4db8-e674-4b20-a207-dd07de7fc01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:39.867298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1a1e4db8-e674-4b20-a207-dd07de7fc01d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:39.868528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1a1e4db8-e674-4b20-a207-dd07de7fc01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:39.962572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 667/1319] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:31:40.001166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cf27d-a6a0-42da-bc69-8c34fc31fbcd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:40.002675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fd0cf27d-a6a0-42da-bc69-8c34fc31fbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:40.104299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cf27d-a6a0-42da-bc69-8c34fc31fbcd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:40.182314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56469e12-be69-489d-ac5d-01ad140f2b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:40.182926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469e12-be69-489d-ac5d-01ad140f2b60 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:40.183208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469e12-be69-489d-ac5d-01ad140f2b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:40.183481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56469e12-be69-489d-ac5d-01ad140f2b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:40.185148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-56469e12-be69-489d-ac5d-01ad140f2b60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:40.192418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:40.293619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56469e12-be69-489d-ac5d-01ad140f2b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:40.295046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56469e12-be69-489d-ac5d-01ad140f2b60 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:40.312952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 653/1320] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:31:42.949653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422b1e6-1a9d-439e-865b-f289e0511f43 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:42.950151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422b1e6-1a9d-439e-865b-f289e0511f43 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:42.950151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422b1e6-1a9d-439e-865b-f289e0511f43 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:42.951508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 668/1321] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:42.956749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4b77f-627d-4035-8c02-dddb27aebf34 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:42.957201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4b77f-627d-4035-8c02-dddb27aebf34 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:42.957306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4b77f-627d-4035-8c02-dddb27aebf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:43.023090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-aea4b77f-627d-4035-8c02-dddb27aebf34 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:43.024327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aea4b77f-627d-4035-8c02-dddb27aebf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:43.081262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:43.123762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 654/1322] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:31:43.161374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422b1e6-1a9d-439e-865b-f289e0511f43 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:43.162950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c422b1e6-1a9d-439e-865b-f289e0511f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:43.184043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:43.272025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422b1e6-1a9d-439e-865b-f289e0511f43 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:43.346303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d8a44-8680-47b3-8b3e-38d76ce3f6a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:43.346927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d8a44-8680-47b3-8b3e-38d76ce3f6a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:43.347204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d8a44-8680-47b3-8b3e-38d76ce3f6a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:43.347480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d8a44-8680-47b3-8b3e-38d76ce3f6a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:43.349171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d52d8a44-8680-47b3-8b3e-38d76ce3f6a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:43.419814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:43.457919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d8a44-8680-47b3-8b3e-38d76ce3f6a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:43.459373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52d8a44-8680-47b3-8b3e-38d76ce3f6a1 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:43.477504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 669/1323] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:31:45.532669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e595170-1b94-41d5-b677-d36a6e0e5aca None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:45.533234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e595170-1b94-41d5-b677-d36a6e0e5aca None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:45.533234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e595170-1b94-41d5-b677-d36a6e0e5aca None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:45.534745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 655/1324] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:45.539835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e719fb-431c-403d-acb6-68be78ef1da3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:45.540285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e719fb-431c-403d-acb6-68be78ef1da3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:45.540423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e719fb-431c-403d-acb6-68be78ef1da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:45.606344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f9e719fb-431c-403d-acb6-68be78ef1da3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:45.607532 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f9e719fb-431c-403d-acb6-68be78ef1da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:45.702037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 670/1325] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:31:45.753549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b613e-4c61-40ed-a3ba-42a162068f21 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:45.753830 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b613e-4c61-40ed-a3ba-42a162068f21 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:45.754121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b613e-4c61-40ed-a3ba-42a162068f21 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:45.755472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 656/1326] 10.222.0.57 () {54 vars in 965 bytes} [Tue Aug 2 21:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:45.761653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd54ffa-d99a-4573-b54a-fa7097399f63 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:45.762023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd54ffa-d99a-4573-b54a-fa7097399f63 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:45.762363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd54ffa-d99a-4573-b54a-fa7097399f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:45.795352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:45.840902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7cd54ffa-d99a-4573-b54a-fa7097399f63 None None] MFA Rules not processed for user `24644cede7e149a6b3e5bd39b930017b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:45.842096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7cd54ffa-d99a-4573-b54a-fa7097399f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:45.915730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 671/1327] 10.222.0.57 () {58 vars in 1062 bytes} [Tue Aug 2 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:31:45.925441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b613e-4c61-40ed-a3ba-42a162068f21 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:45.927067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-450b613e-4c61-40ed-a3ba-42a162068f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:46.031445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b613e-4c61-40ed-a3ba-42a162068f21 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:46.110680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e5821-3947-459f-bffc-bc6da82ed851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:46.111296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e5821-3947-459f-bffc-bc6da82ed851 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:46.112075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e5821-3947-459f-bffc-bc6da82ed851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:46.112402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e5821-3947-459f-bffc-bc6da82ed851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:46.114069 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b11e5821-3947-459f-bffc-bc6da82ed851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:46.131334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:46.222836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e5821-3947-459f-bffc-bc6da82ed851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:46.224380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e5821-3947-459f-bffc-bc6da82ed851 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:46.252594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 657/1328] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:31:48.519187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5b81e-32e4-404a-9937-0cbc5b7ea2f7 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:48.519735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5b81e-32e4-404a-9937-0cbc5b7ea2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:48.519838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5b81e-32e4-404a-9937-0cbc5b7ea2f7 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:48.521224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 672/1329] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:48.526652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936f905-1b7a-48a8-a721-73049a956523 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:48.527070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936f905-1b7a-48a8-a721-73049a956523 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:48.527213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936f905-1b7a-48a8-a721-73049a956523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:48.593258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7936f905-1b7a-48a8-a721-73049a956523 None None] MFA Rules not processed for user `c3a3b12c08684d71aa48c75435606f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:48.594483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7936f905-1b7a-48a8-a721-73049a956523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:48.659714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:48.697618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 658/1330] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:31:48.735377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5b81e-32e4-404a-9937-0cbc5b7ea2f7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:48.736950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2cd5b81e-32e4-404a-9937-0cbc5b7ea2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:48.869643 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5b81e-32e4-404a-9937-0cbc5b7ea2f7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:48.890987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:48.948046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92fa95-2cfc-49aa-89c6-2cf41a0e6af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:48.948705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92fa95-2cfc-49aa-89c6-2cf41a0e6af1 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:48.948989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92fa95-2cfc-49aa-89c6-2cf41a0e6af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:48.949257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92fa95-2cfc-49aa-89c6-2cf41a0e6af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:48.950884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fb92fa95-2cfc-49aa-89c6-2cf41a0e6af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:49.059920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92fa95-2cfc-49aa-89c6-2cf41a0e6af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:49.061399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92fa95-2cfc-49aa-89c6-2cf41a0e6af1 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:49.080065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 673/1331] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:31:51.537484 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375a790-3b63-42f7-a90b-4c3027aaa3d9 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:51.538035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375a790-3b63-42f7-a90b-4c3027aaa3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:51.538035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d375a790-3b63-42f7-a90b-4c3027aaa3d9 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:51.539375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 659/1332] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:51.544665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02117c7-a40e-4871-a3af-2f73d25ef252 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:51.545145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02117c7-a40e-4871-a3af-2f73d25ef252 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:51.545242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02117c7-a40e-4871-a3af-2f73d25ef252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:51.608628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:51.612478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a02117c7-a40e-4871-a3af-2f73d25ef252 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:51.614248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a02117c7-a40e-4871-a3af-2f73d25ef252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:51.709120 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 674/1333] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:31:51.744245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375a790-3b63-42f7-a90b-4c3027aaa3d9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:51.745755 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d375a790-3b63-42f7-a90b-4c3027aaa3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:51.849200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d375a790-3b63-42f7-a90b-4c3027aaa3d9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:51.920851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c582ea2c-767f-4215-bffe-acf816352dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:51.921490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582ea2c-767f-4215-bffe-acf816352dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:51.921770 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582ea2c-767f-4215-bffe-acf816352dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:51.922041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582ea2c-767f-4215-bffe-acf816352dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:51.923655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c582ea2c-767f-4215-bffe-acf816352dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:51.950468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:52.030809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582ea2c-767f-4215-bffe-acf816352dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:52.032259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c582ea2c-767f-4215-bffe-acf816352dbd service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:52.050438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 660/1334] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:31:54.079092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1974c58-e44f-4089-a2df-0ef594380305 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:54.079591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1974c58-e44f-4089-a2df-0ef594380305 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:54.079591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1974c58-e44f-4089-a2df-0ef594380305 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:54.081588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 675/1335] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:54.086627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a3f9-f666-4a91-803f-412bb2b8700f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:54.087046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a3f9-f666-4a91-803f-412bb2b8700f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:54.087180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362a3f9-f666-4a91-803f-412bb2b8700f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:54.155360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1362a3f9-f666-4a91-803f-412bb2b8700f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:54.156596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1362a3f9-f666-4a91-803f-412bb2b8700f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:54.231998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:54.257516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 661/1336] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:31:54.298397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1974c58-e44f-4089-a2df-0ef594380305 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:54.299981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d1974c58-e44f-4089-a2df-0ef594380305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:54.403207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1974c58-e44f-4089-a2df-0ef594380305 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:54.431011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:54.475140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b573b701-841a-4c63-b8b3-e2dd35785c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:54.475750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573b701-841a-4c63-b8b3-e2dd35785c19 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:54.476030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573b701-841a-4c63-b8b3-e2dd35785c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:54.476335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b573b701-841a-4c63-b8b3-e2dd35785c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:54.477974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b573b701-841a-4c63-b8b3-e2dd35785c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:54.583913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573b701-841a-4c63-b8b3-e2dd35785c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:54.585384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b573b701-841a-4c63-b8b3-e2dd35785c19 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:54.603035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 676/1337] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:31:57.062182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf01c5-0163-461d-b41a-af3116cb06b7 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:57.062752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf01c5-0163-461d-b41a-af3116cb06b7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:57.062752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf01c5-0163-461d-b41a-af3116cb06b7 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:57.064085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 662/1338] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:57.069290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76cc84-8dfa-429a-969d-66f817e6011e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:57.069736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76cc84-8dfa-429a-969d-66f817e6011e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:57.069838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76cc84-8dfa-429a-969d-66f817e6011e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:57.134658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9e76cc84-8dfa-429a-969d-66f817e6011e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:57.135865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9e76cc84-8dfa-429a-969d-66f817e6011e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:57.144424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:57.231378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 677/1339] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:31:57.266881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf01c5-0163-461d-b41a-af3116cb06b7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:57.268925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7cbf01c5-0163-461d-b41a-af3116cb06b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:57.373760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf01c5-0163-461d-b41a-af3116cb06b7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:57.444926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbcbd9-a484-40c0-9a2c-6e997da21375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:57.445538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbcbd9-a484-40c0-9a2c-6e997da21375 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:57.445817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbcbd9-a484-40c0-9a2c-6e997da21375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:57.446087 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbcbd9-a484-40c0-9a2c-6e997da21375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:57.447697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-77cbcbd9-a484-40c0-9a2c-6e997da21375 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:57.482660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:57.562104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbcbd9-a484-40c0-9a2c-6e997da21375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:57.563556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbcbd9-a484-40c0-9a2c-6e997da21375 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:57.582265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 663/1340] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:32:01.505069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947cbd-c33b-407c-b8dc-a28f1c3e2a9f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:01.505570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947cbd-c33b-407c-b8dc-a28f1c3e2a9f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:01.505825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947cbd-c33b-407c-b8dc-a28f1c3e2a9f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:01.507363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 678/1341] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:01.512438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424675e2-d03f-4a30-a542-0d04c7d840e0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:01.512844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424675e2-d03f-4a30-a542-0d04c7d840e0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:01.512998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424675e2-d03f-4a30-a542-0d04c7d840e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:01.578598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-424675e2-d03f-4a30-a542-0d04c7d840e0 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:01.579802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-424675e2-d03f-4a30-a542-0d04c7d840e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:01.667614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:01.679126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 664/1342] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:01.717735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947cbd-c33b-407c-b8dc-a28f1c3e2a9f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:01.719375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-38947cbd-c33b-407c-b8dc-a28f1c3e2a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:01.822138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947cbd-c33b-407c-b8dc-a28f1c3e2a9f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:01.861130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:01.897693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd798436-610f-41c4-b041-dad6abc86c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:01.898572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd798436-610f-41c4-b041-dad6abc86c5c service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:01.898849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd798436-610f-41c4-b041-dad6abc86c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:01.899117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd798436-610f-41c4-b041-dad6abc86c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:01.900891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-dd798436-610f-41c4-b041-dad6abc86c5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:02.011876 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd798436-610f-41c4-b041-dad6abc86c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:02.013610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd798436-610f-41c4-b041-dad6abc86c5c service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:02.032467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 679/1343] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:04.640777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ac610-eae3-4db6-902d-8ce200fd4037 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:04.641308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ac610-eae3-4db6-902d-8ce200fd4037 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:04.641308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ac610-eae3-4db6-902d-8ce200fd4037 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:04.642960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 665/1344] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:04.649050 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243934ca-0079-4dec-a5b0-c4b693382e08 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:04.649616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243934ca-0079-4dec-a5b0-c4b693382e08 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:04.649616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243934ca-0079-4dec-a5b0-c4b693382e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:04.723444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-243934ca-0079-4dec-a5b0-c4b693382e08 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:04.724703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-243934ca-0079-4dec-a5b0-c4b693382e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:04.744433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:04.827282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 680/1345] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:04.864586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ac610-eae3-4db6-902d-8ce200fd4037 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:04.866112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ed5ac610-eae3-4db6-902d-8ce200fd4037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:04.971834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ac610-eae3-4db6-902d-8ce200fd4037 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:05.065652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ca1b4-c1bd-478c-89a8-154f57f38118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:05.066523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ca1b4-c1bd-478c-89a8-154f57f38118 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:05.066808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ca1b4-c1bd-478c-89a8-154f57f38118 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:05.067202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ca1b4-c1bd-478c-89a8-154f57f38118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:05.068780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f51ca1b4-c1bd-478c-89a8-154f57f38118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:05.115599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:05.182870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ca1b4-c1bd-478c-89a8-154f57f38118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:05.184332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ca1b4-c1bd-478c-89a8-154f57f38118 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:05.202860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 666/1346] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:09.499358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4706f-d041-4ba8-bd61-6147d7ff8e3b None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:09.499921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4706f-d041-4ba8-bd61-6147d7ff8e3b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:09.499921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4706f-d041-4ba8-bd61-6147d7ff8e3b None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:09.501343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 681/1347] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:09.507099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b5ac-fda7-404b-b6e2-a6eb3b106de2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:09.507506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b5ac-fda7-404b-b6e2-a6eb3b106de2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:09.507671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b5ac-fda7-404b-b6e2-a6eb3b106de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:09.591148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4026b5ac-fda7-404b-b6e2-a6eb3b106de2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:09.592321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4026b5ac-fda7-404b-b6e2-a6eb3b106de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:09.691221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:09.694211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 667/1348] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:09.733033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4706f-d041-4ba8-bd61-6147d7ff8e3b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:09.734612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c0e4706f-d041-4ba8-bd61-6147d7ff8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:09.844179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4706f-d041-4ba8-bd61-6147d7ff8e3b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:09.894190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:09.921986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a500e8-9951-403e-a71d-5f5bfb3d2c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:09.922611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a500e8-9951-403e-a71d-5f5bfb3d2c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:09.922886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a500e8-9951-403e-a71d-5f5bfb3d2c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:09.923153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a500e8-9951-403e-a71d-5f5bfb3d2c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:09.925473 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-70a500e8-9951-403e-a71d-5f5bfb3d2c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:10.039610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a500e8-9951-403e-a71d-5f5bfb3d2c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:10.041136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a500e8-9951-403e-a71d-5f5bfb3d2c96 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:10.061106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 682/1349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:32:14.972462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319af70-ae41-42d2-b7b7-fe3b32b3c830 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:14.972899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319af70-ae41-42d2-b7b7-fe3b32b3c830 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:14.972998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319af70-ae41-42d2-b7b7-fe3b32b3c830 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:14.974660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 668/1350] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:14.979674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ca1b9-b1e6-4dff-a7db-101a318c45d6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:14.980095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ca1b9-b1e6-4dff-a7db-101a318c45d6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:14.980309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ca1b9-b1e6-4dff-a7db-101a318c45d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:15.117592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e69ca1b9-b1e6-4dff-a7db-101a318c45d6 None None] MFA Rules not processed for user `ad52cba0b761482d96b6659654034ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:15.119268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e69ca1b9-b1e6-4dff-a7db-101a318c45d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:15.143876 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:15.250177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 683/1351] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:32:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:19.368429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061dbfa-209d-4889-b0fd-7aea8af370ab None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:19.368983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061dbfa-209d-4889-b0fd-7aea8af370ab None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:19.369396 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061dbfa-209d-4889-b0fd-7aea8af370ab None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:19.370904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 669/1352] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:19.376610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1dfcb-6aea-4a56-97ad-9fbd0846ee1d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:19.377030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1dfcb-6aea-4a56-97ad-9fbd0846ee1d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:19.377160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd1dfcb-6aea-4a56-97ad-9fbd0846ee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:19.454349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4cd1dfcb-6aea-4a56-97ad-9fbd0846ee1d None None] MFA Rules not processed for user `ad52cba0b761482d96b6659654034ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:19.455899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4cd1dfcb-6aea-4a56-97ad-9fbd0846ee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:19.531585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:19.570358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 684/1353] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:32:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:20.952818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4c138-6944-4daf-8a66-7aaca8328743 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:20.953340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4c138-6944-4daf-8a66-7aaca8328743 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:20.953340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab4c138-6944-4daf-8a66-7aaca8328743 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:20.954811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 670/1354] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:20.959883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7270335-efbb-48dd-93d1-0c2cf16e62d3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:20.960337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7270335-efbb-48dd-93d1-0c2cf16e62d3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:20.960591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7270335-efbb-48dd-93d1-0c2cf16e62d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:21.036649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a7270335-efbb-48dd-93d1-0c2cf16e62d3 None None] MFA Rules not processed for user `ad52cba0b761482d96b6659654034ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:21.037847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a7270335-efbb-48dd-93d1-0c2cf16e62d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:21.154307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 685/1355] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:32:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:32:24.399829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5031ee-5bb6-4993-8289-2ad891f1bcbd None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:24.400395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5031ee-5bb6-4993-8289-2ad891f1bcbd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:24.400395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5031ee-5bb6-4993-8289-2ad891f1bcbd None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:24.405622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 671/1356] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:24.407748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cd37f-e6a3-4d40-9d75-ce9e91d40ba8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:24.408522 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cd37f-e6a3-4d40-9d75-ce9e91d40ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:24.409534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cd37f-e6a3-4d40-9d75-ce9e91d40ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:24.454872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:24.497368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-430cd37f-e6a3-4d40-9d75-ce9e91d40ba8 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:24.498716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-430cd37f-e6a3-4d40-9d75-ce9e91d40ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:24.603550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 686/1357] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:24.656866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b70dd-c7a2-4c4e-91dc-c4d26bda345c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:24.657409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b70dd-c7a2-4c4e-91dc-c4d26bda345c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:24.657979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b70dd-c7a2-4c4e-91dc-c4d26bda345c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:24.659584 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 672/1358] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 2 21:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:24.667320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4ae3-706f-4cd6-a9ae-a666bdf451f0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:24.668037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4ae3-706f-4cd6-a9ae-a666bdf451f0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:24.668643 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7f4ae3-706f-4cd6-a9ae-a666bdf451f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:24.762665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1b7f4ae3-706f-4cd6-a9ae-a666bdf451f0 None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:24.763852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1b7f4ae3-706f-4cd6-a9ae-a666bdf451f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:24.819115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:24.894880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 687/1359] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 2 21:32:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:24.902895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b70dd-c7a2-4c4e-91dc-c4d26bda345c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:24.904448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5e7b70dd-c7a2-4c4e-91dc-c4d26bda345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:25.059322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b70dd-c7a2-4c4e-91dc-c4d26bda345c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:25.144114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:25.189181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10263771-eeee-4e88-b229-6f07553aedb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:25.189848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10263771-eeee-4e88-b229-6f07553aedb6 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:25.190789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10263771-eeee-4e88-b229-6f07553aedb6 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:25.191165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10263771-eeee-4e88-b229-6f07553aedb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:25.192995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-10263771-eeee-4e88-b229-6f07553aedb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:25.287351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10263771-eeee-4e88-b229-6f07553aedb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:25.289196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10263771-eeee-4e88-b229-6f07553aedb6 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:25.308831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 673/1360] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:27.553322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ef581-20bb-48d5-8e72-4d67197118c8 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:27.553919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ef581-20bb-48d5-8e72-4d67197118c8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:27.553919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ef581-20bb-48d5-8e72-4d67197118c8 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:27.555468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 688/1361] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:27.560790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009077c-b71d-4804-9751-8557bfe2de7b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:27.561277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009077c-b71d-4804-9751-8557bfe2de7b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:27.561365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009077c-b71d-4804-9751-8557bfe2de7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:27.629984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1009077c-b71d-4804-9751-8557bfe2de7b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:27.631114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1009077c-b71d-4804-9751-8557bfe2de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:27.670915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:27.739788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 674/1362] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:27.785319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ef581-20bb-48d5-8e72-4d67197118c8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:27.786909 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e60ef581-20bb-48d5-8e72-4d67197118c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:27.958118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ef581-20bb-48d5-8e72-4d67197118c8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:27.968074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:28.096979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edc86e-67d9-4b53-82e4-6681dd22c23e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:28.097600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc86e-67d9-4b53-82e4-6681dd22c23e service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:28.097934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc86e-67d9-4b53-82e4-6681dd22c23e service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:28.098214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edc86e-67d9-4b53-82e4-6681dd22c23e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:28.099844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f9edc86e-67d9-4b53-82e4-6681dd22c23e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:28.202731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edc86e-67d9-4b53-82e4-6681dd22c23e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:28.204499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9edc86e-67d9-4b53-82e4-6681dd22c23e service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:28.224377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 689/1363] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:30.582608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fdfd2-ca32-46ff-afce-3cc8b006ac74 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:30.583161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fdfd2-ca32-46ff-afce-3cc8b006ac74 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:30.583303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06fdfd2-ca32-46ff-afce-3cc8b006ac74 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:30.584786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 675/1364] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:30.590969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000dcf2-24ae-40d6-93cf-00e02ef3b214 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:30.591422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000dcf2-24ae-40d6-93cf-00e02ef3b214 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:30.591520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000dcf2-24ae-40d6-93cf-00e02ef3b214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:30.615501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:30.672938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2000dcf2-24ae-40d6-93cf-00e02ef3b214 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:30.674407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2000dcf2-24ae-40d6-93cf-00e02ef3b214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:30.785815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 690/1365] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:30.833927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d34a5-f3cf-48db-b0c7-53fe53c42374 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:30.834121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d34a5-f3cf-48db-b0c7-53fe53c42374 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:30.834508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d34a5-f3cf-48db-b0c7-53fe53c42374 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:30.836049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 676/1366] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 2 21:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:30.841774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbac54-084d-4c1c-b0b0-8b180e0bfea0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:30.842138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbac54-084d-4c1c-b0b0-8b180e0bfea0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:30.842481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccbac54-084d-4c1c-b0b0-8b180e0bfea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:30.923534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-dccbac54-084d-4c1c-b0b0-8b180e0bfea0 None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:30.925281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-dccbac54-084d-4c1c-b0b0-8b180e0bfea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:30.961644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:31.047762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 691/1367] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 2 21:32:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:31.056031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d34a5-f3cf-48db-b0c7-53fe53c42374 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:31.057565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-085d34a5-f3cf-48db-b0c7-53fe53c42374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:31.230084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d34a5-f3cf-48db-b0c7-53fe53c42374 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:31.251397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:31.348657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cd0a6-16e4-4ef1-a0f7-a6259da021af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:31.349272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cd0a6-16e4-4ef1-a0f7-a6259da021af service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:31.349544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cd0a6-16e4-4ef1-a0f7-a6259da021af service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:31.349811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cd0a6-16e4-4ef1-a0f7-a6259da021af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:31.351416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-589cd0a6-16e4-4ef1-a0f7-a6259da021af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:31.444745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589cd0a6-16e4-4ef1-a0f7-a6259da021af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:31.446253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589cd0a6-16e4-4ef1-a0f7-a6259da021af service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:31.464590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 677/1368] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:32.529787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af81b4-9715-4902-8989-f4e6a5ffe9ff None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:32.530366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af81b4-9715-4902-8989-f4e6a5ffe9ff None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:32.530630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af81b4-9715-4902-8989-f4e6a5ffe9ff None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:32.532245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 692/1369] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:32.537792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f18162-09ed-4a7b-a935-0e6f2b796323 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:32.538223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f18162-09ed-4a7b-a935-0e6f2b796323 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:32.538327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f18162-09ed-4a7b-a935-0e6f2b796323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:32.572931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:32.610196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-38f18162-09ed-4a7b-a935-0e6f2b796323 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:32.611403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-38f18162-09ed-4a7b-a935-0e6f2b796323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:32.719866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 678/1370] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:33.078269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afee68-982d-46cd-b884-40b027eb5c55 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:33.078269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afee68-982d-46cd-b884-40b027eb5c55 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:33.078269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35afee68-982d-46cd-b884-40b027eb5c55 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:33.080531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 693/1371] 10.222.0.57 () {54 vars in 964 bytes} [Tue Aug 2 21:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:33.085037 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261718-e238-489f-ba7a-340db63bf5dd None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:33.085276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261718-e238-489f-ba7a-340db63bf5dd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:33.085533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d261718-e238-489f-ba7a-340db63bf5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:33.168691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9d261718-e238-489f-ba7a-340db63bf5dd None None] MFA Rules not processed for user `124c246d00a841608a2bc4f5230f4eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:33.169892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9d261718-e238-489f-ba7a-340db63bf5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:33.219238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:33.252445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 679/1372] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Aug 2 21:32:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:33.260549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afee68-982d-46cd-b884-40b027eb5c55 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:33.262114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-35afee68-982d-46cd-b884-40b027eb5c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:33.371724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35afee68-982d-46cd-b884-40b027eb5c55 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:33.413545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:33.449435 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:33.450094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:33.450653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:33.450930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:33.452603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:33.556969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8925b-468a-4eb6-a6cf-f536ade4e349 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:33.556969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8925b-468a-4eb6-a6cf-f536ade4e349 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:33.557647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee8925b-468a-4eb6-a6cf-f536ade4e349 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:33.558607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 680/1373] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:33.563636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324018-de75-4a48-8900-7dec7032628a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:33.563922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324018-de75-4a48-8900-7dec7032628a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:33.564279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85324018-de75-4a48-8900-7dec7032628a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:33.572828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:33.574639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:33.594597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 694/1374] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:32:33.641532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-85324018-de75-4a48-8900-7dec7032628a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:33.642803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-85324018-de75-4a48-8900-7dec7032628a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:33.758121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 681/1375] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:32:33.806975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:33.806975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:33.880683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:33.923105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac719b-f61d-43a4-ab3e-0a402802a77a service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:34.047442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8bf0b-49d7-4837-a486-eb3b02d1f553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:34.048067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8bf0b-49d7-4837-a486-eb3b02d1f553 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:34.048377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8bf0b-49d7-4837-a486-eb3b02d1f553 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:34.048651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8bf0b-49d7-4837-a486-eb3b02d1f553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:34.050802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bca8bf0b-49d7-4837-a486-eb3b02d1f553 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:34.127179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:34.138791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8bf0b-49d7-4837-a486-eb3b02d1f553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:34.140427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8bf0b-49d7-4837-a486-eb3b02d1f553 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:34.158352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 695/1376] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:36.243190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490397-cfd9-40d1-ade2-9deb41c2b476 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:36.243681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490397-cfd9-40d1-ade2-9deb41c2b476 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:36.243897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490397-cfd9-40d1-ade2-9deb41c2b476 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:36.245554 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 682/1377] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:36.250600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d919ed6-3ca6-4755-9b39-8a167b11f6d0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:36.251038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d919ed6-3ca6-4755-9b39-8a167b11f6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:36.251295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d919ed6-3ca6-4755-9b39-8a167b11f6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:36.317934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7d919ed6-3ca6-4755-9b39-8a167b11f6d0 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:36.319571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7d919ed6-3ca6-4755-9b39-8a167b11f6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:36.419313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 696/1378] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:32:36.463405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490397-cfd9-40d1-ade2-9deb41c2b476 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:36.465074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-45490397-cfd9-40d1-ade2-9deb41c2b476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:36.519897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:36.644183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490397-cfd9-40d1-ade2-9deb41c2b476 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:36.766216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5475cec3-af63-4882-9e45-f42101b16d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:36.766769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475cec3-af63-4882-9e45-f42101b16d93 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:36.767056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475cec3-af63-4882-9e45-f42101b16d93 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:36.767332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5475cec3-af63-4882-9e45-f42101b16d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:36.769067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5475cec3-af63-4882-9e45-f42101b16d93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:36.780715 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:36.866612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475cec3-af63-4882-9e45-f42101b16d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:36.868329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5475cec3-af63-4882-9e45-f42101b16d93 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:36.886455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 683/1379] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:38.973050 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7120cd5-f2bb-4a49-bc67-533af2dc4457 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:38.973497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7120cd5-f2bb-4a49-bc67-533af2dc4457 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:38.973631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7120cd5-f2bb-4a49-bc67-533af2dc4457 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:38.975001 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 697/1380] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:38.980025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4258bd0-8b93-4e21-aee2-ad260f9e3502 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:38.980472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4258bd0-8b93-4e21-aee2-ad260f9e3502 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:38.980617 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4258bd0-8b93-4e21-aee2-ad260f9e3502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:39.050185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e4258bd0-8b93-4e21-aee2-ad260f9e3502 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:39.051399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e4258bd0-8b93-4e21-aee2-ad260f9e3502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:39.152361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:39.175400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 684/1381] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:39.217287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7120cd5-f2bb-4a49-bc67-533af2dc4457 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:39.218812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e7120cd5-f2bb-4a49-bc67-533af2dc4457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:39.286943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:39.373597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7120cd5-f2bb-4a49-bc67-533af2dc4457 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:39.507302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb055467-d7f5-4129-b68e-50f4d7a1d1e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:39.507923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055467-d7f5-4129-b68e-50f4d7a1d1e2 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:39.508234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055467-d7f5-4129-b68e-50f4d7a1d1e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:39.508543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb055467-d7f5-4129-b68e-50f4d7a1d1e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:39.510320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bb055467-d7f5-4129-b68e-50f4d7a1d1e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:39.535041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:39.606020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb055467-d7f5-4129-b68e-50f4d7a1d1e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:39.607700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb055467-d7f5-4129-b68e-50f4d7a1d1e2 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:39.626239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 698/1382] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:41.676647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ce0bb-3f7e-4bd9-9f6f-da111e7e28d6 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:41.677213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ce0bb-3f7e-4bd9-9f6f-da111e7e28d6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:41.677360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ce0bb-3f7e-4bd9-9f6f-da111e7e28d6 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:41.679190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 685/1383] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:41.684476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea5703-5ca3-42e5-94f7-baa45f1459b8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:41.684963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea5703-5ca3-42e5-94f7-baa45f1459b8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:41.685114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea5703-5ca3-42e5-94f7-baa45f1459b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:41.751497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f1ea5703-5ca3-42e5-94f7-baa45f1459b8 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:41.753345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f1ea5703-5ca3-42e5-94f7-baa45f1459b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:41.867673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:41.871590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 699/1384] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:41.914718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ce0bb-3f7e-4bd9-9f6f-da111e7e28d6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:41.916893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f73ce0bb-3f7e-4bd9-9f6f-da111e7e28d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:42.068354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ce0bb-3f7e-4bd9-9f6f-da111e7e28d6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:42.130430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:42.188298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1f6b6-bb2c-4672-9cc0-5bc4f725e86d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:42.188910 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f6b6-bb2c-4672-9cc0-5bc4f725e86d service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:42.189194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f6b6-bb2c-4672-9cc0-5bc4f725e86d service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:42.189468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1f6b6-bb2c-4672-9cc0-5bc4f725e86d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:42.191139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-87c1f6b6-bb2c-4672-9cc0-5bc4f725e86d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:42.282925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1f6b6-bb2c-4672-9cc0-5bc4f725e86d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:42.284056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1f6b6-bb2c-4672-9cc0-5bc4f725e86d service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:42.302663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 686/1385] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:44.369799 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a882c5-9a0a-4e29-a7f1-33f5c0998b86 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:44.371527 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a882c5-9a0a-4e29-a7f1-33f5c0998b86 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:44.371527 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a882c5-9a0a-4e29-a7f1-33f5c0998b86 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:44.372303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 700/1386] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:44.378752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42da9a-5e50-4eba-a7b8-02a21bfb2bd1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:44.379219 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42da9a-5e50-4eba-a7b8-02a21bfb2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:44.379312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42da9a-5e50-4eba-a7b8-02a21bfb2bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:44.465978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fe42da9a-5e50-4eba-a7b8-02a21bfb2bd1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:44.467231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fe42da9a-5e50-4eba-a7b8-02a21bfb2bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:44.495851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:44.579708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 687/1387] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:32:44.625428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a882c5-9a0a-4e29-a7f1-33f5c0998b86 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:44.627451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d7a882c5-9a0a-4e29-a7f1-33f5c0998b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:44.811722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a882c5-9a0a-4e29-a7f1-33f5c0998b86 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:44.892991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:44.954554 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda451f-f93a-406b-9890-2a1096f37590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:44.955756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda451f-f93a-406b-9890-2a1096f37590 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:44.955894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda451f-f93a-406b-9890-2a1096f37590 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:44.956841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda451f-f93a-406b-9890-2a1096f37590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:44.959191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7eda451f-f93a-406b-9890-2a1096f37590 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:45.074609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda451f-f93a-406b-9890-2a1096f37590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:45.076275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda451f-f93a-406b-9890-2a1096f37590 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:45.107214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 701/1388] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:47.295587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36ed8-8691-454f-95d6-d947a76901ed None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:47.296118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36ed8-8691-454f-95d6-d947a76901ed None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:47.296118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc36ed8-8691-454f-95d6-d947a76901ed None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:47.297700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 688/1389] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:47.304180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821649-d7cb-4be1-9e6e-322bbc811745 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:47.304180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821649-d7cb-4be1-9e6e-322bbc811745 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:47.304180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821649-d7cb-4be1-9e6e-322bbc811745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:47.381219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e4821649-d7cb-4be1-9e6e-322bbc811745 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:47.382725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e4821649-d7cb-4be1-9e6e-322bbc811745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:47.421739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:47.491794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 702/1390] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:47.538245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc36ed8-8691-454f-95d6-d947a76901ed None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:47.539804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2bc36ed8-8691-454f-95d6-d947a76901ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:47.707181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc36ed8-8691-454f-95d6-d947a76901ed None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:47.717856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:47.839501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d56b4-ce05-444a-96da-6c3260e76e16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:47.840121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d56b4-ce05-444a-96da-6c3260e76e16 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:47.840436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d56b4-ce05-444a-96da-6c3260e76e16 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:47.840705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d56b4-ce05-444a-96da-6c3260e76e16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:47.842337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e06d56b4-ce05-444a-96da-6c3260e76e16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:47.939269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d56b4-ce05-444a-96da-6c3260e76e16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:47.941510 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d56b4-ce05-444a-96da-6c3260e76e16 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:47.961546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 689/1391] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:48.658126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a79af-ff28-4884-a6f9-c983217f7389 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:48.658622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a79af-ff28-4884-a6f9-c983217f7389 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:48.658721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a79af-ff28-4884-a6f9-c983217f7389 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:48.660046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 703/1392] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:48.665269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6ea9-9c35-4742-93c3-cd8ee1b77f20 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:48.665711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6ea9-9c35-4742-93c3-cd8ee1b77f20 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:48.665810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b6ea9-9c35-4742-93c3-cd8ee1b77f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:48.681537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:48.739683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7b3b6ea9-9c35-4742-93c3-cd8ee1b77f20 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:48.741381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b3b6ea9-9c35-4742-93c3-cd8ee1b77f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:48.853615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 690/1393] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:48.910024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92f56-9136-4e59-9727-33743038d0fb None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:48.910316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92f56-9136-4e59-9727-33743038d0fb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:48.910593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b92f56-9136-4e59-9727-33743038d0fb None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:48.912101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 704/1394] 10.222.0.57 () {54 vars in 966 bytes} [Tue Aug 2 21:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:48.917416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c38628-f7db-468e-b0a5-5964e3618bc9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:48.917710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c38628-f7db-468e-b0a5-5964e3618bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:48.917985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c38628-f7db-468e-b0a5-5964e3618bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:49.006007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-19c38628-f7db-468e-b0a5-5964e3618bc9 None None] MFA Rules not processed for user `4e3cd62eb975492aab4a136c0e9825a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:49.007289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-19c38628-f7db-468e-b0a5-5964e3618bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:49.046508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:49.092279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 691/1395] 10.222.0.57 () {58 vars in 1063 bytes} [Tue Aug 2 21:32:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:32:49.100082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92f56-9136-4e59-9727-33743038d0fb None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:49.102700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f7b92f56-9136-4e59-9727-33743038d0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:49.227485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b92f56-9136-4e59-9727-33743038d0fb None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:49.294580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:49.307389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed32eec-d3bc-48f2-bc0d-d05c2c32e8b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cd62eb975492aab4a136c0e9825a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:49.308018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32eec-d3bc-48f2-bc0d-d05c2c32e8b3 service glance] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:49.308332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32eec-d3bc-48f2-bc0d-d05c2c32e8b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:49.308610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32eec-d3bc-48f2-bc0d-d05c2c32e8b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:49.310259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-aed32eec-d3bc-48f2-bc0d-d05c2c32e8b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:49.446766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed32eec-d3bc-48f2-bc0d-d05c2c32e8b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:49.448407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed32eec-d3bc-48f2-bc0d-d05c2c32e8b3 service glance] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:49.468695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 705/1396] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:32:50.020466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414ec9b-4f91-40f4-8612-134d0041ec6e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:50.020931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414ec9b-4f91-40f4-8612-134d0041ec6e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:50.021022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414ec9b-4f91-40f4-8612-134d0041ec6e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:50.026256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 692/1397] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:50.027995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac489d2f-cff3-4c14-a462-1b8cbb45a965 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:50.028440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac489d2f-cff3-4c14-a462-1b8cbb45a965 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:50.028617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac489d2f-cff3-4c14-a462-1b8cbb45a965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:50.101660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ac489d2f-cff3-4c14-a462-1b8cbb45a965 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:50.103309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ac489d2f-cff3-4c14-a462-1b8cbb45a965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:50.158357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:50.232165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 706/1398] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:50.275329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436824a7-beeb-4f9c-93b7-41f5423a0877 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:50.275867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436824a7-beeb-4f9c-93b7-41f5423a0877 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:50.276161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436824a7-beeb-4f9c-93b7-41f5423a0877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:50.281381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac489d2f-cff3-4c14-a462-1b8cbb45a965 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:50.282723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ac489d2f-cff3-4c14-a462-1b8cbb45a965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:50.356429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-436824a7-beeb-4f9c-93b7-41f5423a0877 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:50.357634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-436824a7-beeb-4f9c-93b7-41f5423a0877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:50.420274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac489d2f-cff3-4c14-a462-1b8cbb45a965 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:50.465826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 693/1399] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:50.488750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:50.514781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67512132-cb2d-4515-87eb-c971c7281ba8 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:50.515072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67512132-cb2d-4515-87eb-c971c7281ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:50.515353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67512132-cb2d-4515-87eb-c971c7281ba8 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:50.517038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 694/1400] 10.222.0.57 () {54 vars in 943 bytes} [Tue Aug 2 21:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:50.524050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b475b-7974-4f74-938d-beca194ba364 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:50.524364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b475b-7974-4f74-938d-beca194ba364 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:50.524640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b475b-7974-4f74-938d-beca194ba364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:50.554618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:50.555414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:50.555806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:50.556163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:50.557945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:50.592337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:50.612714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-491b475b-7974-4f74-938d-beca194ba364 None None] MFA Rules not processed for user `fa5d7ef1e1cd4185b3f0eb8215bf0dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:50.614026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-491b475b-7974-4f74-938d-beca194ba364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:50.653750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:50.655379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:50.676498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 707/1401] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:32:50.738320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 695/1402] 10.222.0.57 () {58 vars in 1040 bytes} [Tue Aug 2 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:32:50.749469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:50.750832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:50.854858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:50.884821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26353d8c-4a6f-460b-b0be-be5326c702c5 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:51.013226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c850d-08a8-42d3-938d-221f5ac51156 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:51.014302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c850d-08a8-42d3-938d-221f5ac51156 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:51.014801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c850d-08a8-42d3-938d-221f5ac51156 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:51.015174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c850d-08a8-42d3-938d-221f5ac51156 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:51.017069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f31c850d-08a8-42d3-938d-221f5ac51156 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:51.107249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c850d-08a8-42d3-938d-221f5ac51156 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:51.109208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c850d-08a8-42d3-938d-221f5ac51156 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:51.117331 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 708/1403] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:32:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:32:52.775988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7832a2-66a9-4103-a5de-a7d15cf00c95 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:52.776620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7832a2-66a9-4103-a5de-a7d15cf00c95 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:52.776620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7832a2-66a9-4103-a5de-a7d15cf00c95 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:52.778037 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 696/1404] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:32:52.783257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaa4db-1a05-4d95-a5d5-334dddeef972 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:52.783694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaa4db-1a05-4d95-a5d5-334dddeef972 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:52.783839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eaa4db-1a05-4d95-a5d5-334dddeef972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:52.804680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:52.861865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-45eaa4db-1a05-4d95-a5d5-334dddeef972 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:52.863141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-45eaa4db-1a05-4d95-a5d5-334dddeef972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:52.975104 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 709/1405] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:53.030274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7832a2-66a9-4103-a5de-a7d15cf00c95 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:53.031990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7d7832a2-66a9-4103-a5de-a7d15cf00c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:53.154757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:53.205386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7832a2-66a9-4103-a5de-a7d15cf00c95 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:53.327629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003ce70-c0ba-4869-99b6-8a230c964494 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:53.328278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003ce70-c0ba-4869-99b6-8a230c964494 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:53.328563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003ce70-c0ba-4869-99b6-8a230c964494 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:53.328837 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003ce70-c0ba-4869-99b6-8a230c964494 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:53.330470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b003ce70-c0ba-4869-99b6-8a230c964494 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:53.413994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:53.436327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003ce70-c0ba-4869-99b6-8a230c964494 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:53.438065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003ce70-c0ba-4869-99b6-8a230c964494 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:53.459512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 697/1406] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:55.524305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b157a94-077c-4e0d-b32f-c645e4e62bde None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:55.524848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b157a94-077c-4e0d-b32f-c645e4e62bde None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:55.524848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b157a94-077c-4e0d-b32f-c645e4e62bde None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:55.526365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 710/1407] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:55.531817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2911f-4a97-428a-b12e-e28630278934 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:55.532297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2911f-4a97-428a-b12e-e28630278934 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:55.532398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2911f-4a97-428a-b12e-e28630278934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:55.670785 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0cd2911f-4a97-428a-b12e-e28630278934 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:55.672034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0cd2911f-4a97-428a-b12e-e28630278934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:55.801477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 698/1408] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:55.846499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b157a94-077c-4e0d-b32f-c645e4e62bde None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:55.849280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0b157a94-077c-4e0d-b32f-c645e4e62bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:55.964226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:56.028401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b157a94-077c-4e0d-b32f-c645e4e62bde None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:56.157393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b3b0c-7c77-436c-a7a2-c26b163e9b32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:56.158165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b3b0c-7c77-436c-a7a2-c26b163e9b32 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:56.158469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b3b0c-7c77-436c-a7a2-c26b163e9b32 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:56.158745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b3b0c-7c77-436c-a7a2-c26b163e9b32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:56.160547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fb5b3b0c-7c77-436c-a7a2-c26b163e9b32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:56.222234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:56.258764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b3b0c-7c77-436c-a7a2-c26b163e9b32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:56.260466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b3b0c-7c77-436c-a7a2-c26b163e9b32 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:56.280080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 711/1409] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:05.798621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=79 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:06.277738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=21 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:13.238638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba925b-0e80-4d9c-8358-5d0368143771 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:13.239204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba925b-0e80-4d9c-8358-5d0368143771 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:13.239204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba925b-0e80-4d9c-8358-5d0368143771 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:13.240656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 699/1410] 10.222.0.57 () {54 vars in 918 bytes} [Tue Aug 2 21:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:13.245536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b16fd-9874-476f-9129-869e33c372c8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:13.245939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b16fd-9874-476f-9129-869e33c372c8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:13.246109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b16fd-9874-476f-9129-869e33c372c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:13.319620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-335b16fd-9874-476f-9129-869e33c372c8 None None] MFA Rules not processed for user `ad52cba0b761482d96b6659654034ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:13.320849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-335b16fd-9874-476f-9129-869e33c372c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:13.424710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 712/1411] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Aug 2 21:33:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:13.439472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a6a09-eca0-49ce-bfcb-56eb371aa85c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:13.439779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a6a09-eca0-49ce-bfcb-56eb371aa85c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:13.440060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a6a09-eca0-49ce-bfcb-56eb371aa85c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:13.441468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 700/1412] 10.222.0.57 () {54 vars in 918 bytes} [Tue Aug 2 21:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:13.445991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ebc6c-7b1e-4537-8fc6-cb6c25207d1e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:13.446275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ebc6c-7b1e-4537-8fc6-cb6c25207d1e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:13.446549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ebc6c-7b1e-4537-8fc6-cb6c25207d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:13.517272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:13.519876 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7e0ebc6c-7b1e-4537-8fc6-cb6c25207d1e None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:13.521824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7e0ebc6c-7b1e-4537-8fc6-cb6c25207d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:13.637380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 713/1413] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Aug 2 21:33:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:16.102023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd6380-48c4-4758-9a4e-fb3a51094de1 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:16.102562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd6380-48c4-4758-9a4e-fb3a51094de1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:16.102562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd6380-48c4-4758-9a4e-fb3a51094de1 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:16.103835 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:16.109036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed932-a6f4-4723-bb78-0e1dae59206f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:16.109444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed932-a6f4-4723-bb78-0e1dae59206f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:16.109589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ed932-a6f4-4723-bb78-0e1dae59206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:16.174206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8f8ed932-a6f4-4723-bb78-0e1dae59206f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:16.175949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8f8ed932-a6f4-4723-bb78-0e1dae59206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:16.229457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:16.287525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:16.330366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd6380-48c4-4758-9a4e-fb3a51094de1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:16.332045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ddfd6380-48c4-4758-9a4e-fb3a51094de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:16.474602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd6380-48c4-4758-9a4e-fb3a51094de1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:16.551444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:16.601940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c3f9b-7f27-442b-b1f3-c25179b96cdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:16.602566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c3f9b-7f27-442b-b1f3-c25179b96cdf service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:16.602850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c3f9b-7f27-442b-b1f3-c25179b96cdf service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:16.603126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c3f9b-7f27-442b-b1f3-c25179b96cdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:16.604816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6b9c3f9b-7f27-442b-b1f3-c25179b96cdf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:16.692240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c3f9b-7f27-442b-b1f3-c25179b96cdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:16.693831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9c3f9b-7f27-442b-b1f3-c25179b96cdf service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:16.712035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 702/1416] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:17.599903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868cf99-3fd9-492f-8c0b-db011d113c6d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:17.600502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868cf99-3fd9-492f-8c0b-db011d113c6d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:17.600502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868cf99-3fd9-492f-8c0b-db011d113c6d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:17.601827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:17.606822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24101d8b-0ae8-4afd-a37e-0141f8c519f3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:17.607236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24101d8b-0ae8-4afd-a37e-0141f8c519f3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:17.607386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24101d8b-0ae8-4afd-a37e-0141f8c519f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:17.685741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-24101d8b-0ae8-4afd-a37e-0141f8c519f3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:17.686943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-24101d8b-0ae8-4afd-a37e-0141f8c519f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:17.713444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:17.782047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:17.932992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868cf99-3fd9-492f-8c0b-db011d113c6d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:17.934447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0868cf99-3fd9-492f-8c0b-db011d113c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:18.087343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868cf99-3fd9-492f-8c0b-db011d113c6d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:18.126357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:18.198543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e2fc4-7ecd-4e8b-a50a-6101676bea21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:18.199072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e2fc4-7ecd-4e8b-a50a-6101676bea21 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:18.199355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e2fc4-7ecd-4e8b-a50a-6101676bea21 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:18.199631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e2fc4-7ecd-4e8b-a50a-6101676bea21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:18.201304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1f8e2fc4-7ecd-4e8b-a50a-6101676bea21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:18.289189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e2fc4-7ecd-4e8b-a50a-6101676bea21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:18.290788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e2fc4-7ecd-4e8b-a50a-6101676bea21 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:18.308297 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 716/1419] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:19.185492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c50ae-f7b5-4aa3-9672-f9380c1098b3 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:19.186081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c50ae-f7b5-4aa3-9672-f9380c1098b3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:19.186081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c50ae-f7b5-4aa3-9672-f9380c1098b3 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:19.187410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:19.192848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eda649-3d7a-46b7-9ec8-ae98ca2cc263 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:19.193222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eda649-3d7a-46b7-9ec8-ae98ca2cc263 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:19.193413 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eda649-3d7a-46b7-9ec8-ae98ca2cc263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:19.247665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:19.268843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-15eda649-3d7a-46b7-9ec8-ae98ca2cc263 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:19.270040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-15eda649-3d7a-46b7-9ec8-ae98ca2cc263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:19.367340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:19.518418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c50ae-f7b5-4aa3-9672-f9380c1098b3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:19.520459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-581c50ae-f7b5-4aa3-9672-f9380c1098b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:19.663607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c50ae-f7b5-4aa3-9672-f9380c1098b3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:19.675430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:19.773719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ba4a-71fd-409f-b979-12e777d4ed49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:19.774265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ba4a-71fd-409f-b979-12e777d4ed49 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:19.774528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ba4a-71fd-409f-b979-12e777d4ed49 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:19.774793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ba4a-71fd-409f-b979-12e777d4ed49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:19.776667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b466ba4a-71fd-409f-b979-12e777d4ed49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:19.864867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ba4a-71fd-409f-b979-12e777d4ed49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:19.866464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ba4a-71fd-409f-b979-12e777d4ed49 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:19.884329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 705/1422] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:20.745902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482768-1131-4a86-bbd6-9075412aa5ee None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:20.746441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482768-1131-4a86-bbd6-9075412aa5ee None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:20.746441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482768-1131-4a86-bbd6-9075412aa5ee None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:20.747783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:20.752889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b432-d6af-4d08-853c-cd94bdb650b6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:20.753283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b432-d6af-4d08-853c-cd94bdb650b6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:20.753440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b432-d6af-4d08-853c-cd94bdb650b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:20.773277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:20.834874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1150b432-d6af-4d08-853c-cd94bdb650b6 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:20.836076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1150b432-d6af-4d08-853c-cd94bdb650b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:20.933434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:21.083130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482768-1131-4a86-bbd6-9075412aa5ee None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:21.084689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bc482768-1131-4a86-bbd6-9075412aa5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:21.192233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:21.229972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc482768-1131-4a86-bbd6-9075412aa5ee None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:21.339142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942abdd-e823-4989-a36c-ceb3b57bbe4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:21.339744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942abdd-e823-4989-a36c-ceb3b57bbe4b service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:21.340022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942abdd-e823-4989-a36c-ceb3b57bbe4b service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:21.340324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942abdd-e823-4989-a36c-ceb3b57bbe4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:21.341945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a942abdd-e823-4989-a36c-ceb3b57bbe4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:21.415980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:21.429853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942abdd-e823-4989-a36c-ceb3b57bbe4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:21.431436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a942abdd-e823-4989-a36c-ceb3b57bbe4b service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:21.449134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 719/1425] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:22.306159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c31a1-ff7d-4027-8f77-3309ba19a46e None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:22.306736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c31a1-ff7d-4027-8f77-3309ba19a46e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:22.306736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7c31a1-ff7d-4027-8f77-3309ba19a46e None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:22.308112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:22.313658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8b808-9f10-4691-a452-dde3f12b32a1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:22.314069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8b808-9f10-4691-a452-dde3f12b32a1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:22.314197 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8b808-9f10-4691-a452-dde3f12b32a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:22.388876 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f1f8b808-9f10-4691-a452-dde3f12b32a1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:22.390082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f1f8b808-9f10-4691-a452-dde3f12b32a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:22.488126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:22.645597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c31a1-ff7d-4027-8f77-3309ba19a46e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:22.647040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6c7c31a1-ff7d-4027-8f77-3309ba19a46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:22.730040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:22.791916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7c31a1-ff7d-4027-8f77-3309ba19a46e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:22.903267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678b0b-ae0c-4921-b939-86adf9e2b7ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:22.903808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678b0b-ae0c-4921-b939-86adf9e2b7ce service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:22.904090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678b0b-ae0c-4921-b939-86adf9e2b7ce service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:22.904456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678b0b-ae0c-4921-b939-86adf9e2b7ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:22.906098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-17678b0b-ae0c-4921-b939-86adf9e2b7ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:22.953016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:22.994479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678b0b-ae0c-4921-b939-86adf9e2b7ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:22.996100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678b0b-ae0c-4921-b939-86adf9e2b7ce service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:23.017800 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 708/1428] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:23.823643 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6ac18-2072-4361-9692-d510ec9a3a72 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:23.824107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6ac18-2072-4361-9692-d510ec9a3a72 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:23.824248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6ac18-2072-4361-9692-d510ec9a3a72 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:23.825572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:23.830618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcccf4-d358-440e-a8ef-2ad25deb6c9b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:23.831015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcccf4-d358-440e-a8ef-2ad25deb6c9b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:23.831194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcccf4-d358-440e-a8ef-2ad25deb6c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:23.906586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-71fcccf4-d358-440e-a8ef-2ad25deb6c9b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:23.907769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-71fcccf4-d358-440e-a8ef-2ad25deb6c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:24.010112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:24.159945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6ac18-2072-4361-9692-d510ec9a3a72 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:24.161429 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-31e6ac18-2072-4361-9692-d510ec9a3a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:24.208961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:24.308992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6ac18-2072-4361-9692-d510ec9a3a72 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:24.418608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843174f4-f189-4199-b22b-521ccf6c3e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:24.419155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843174f4-f189-4199-b22b-521ccf6c3e54 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:24.419437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843174f4-f189-4199-b22b-521ccf6c3e54 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:24.419707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843174f4-f189-4199-b22b-521ccf6c3e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:24.421385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-843174f4-f189-4199-b22b-521ccf6c3e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:24.428125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:24.519467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843174f4-f189-4199-b22b-521ccf6c3e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:24.521192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843174f4-f189-4199-b22b-521ccf6c3e54 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:24.539154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 722/1431] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:25.343674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9e39-c79c-4f9a-9fc7-8cd5a2dbe679 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:25.344264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9e39-c79c-4f9a-9fc7-8cd5a2dbe679 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:25.344264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b9e39-c79c-4f9a-9fc7-8cd5a2dbe679 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:25.345667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:25.351024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe445d-f64c-4947-b774-3b54e65c9acc None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:25.351460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe445d-f64c-4947-b774-3b54e65c9acc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:25.351584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe445d-f64c-4947-b774-3b54e65c9acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:25.425502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-afbe445d-f64c-4947-b774-3b54e65c9acc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:25.426689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-afbe445d-f64c-4947-b774-3b54e65c9acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:25.492440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:25.521804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:25.678296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b9e39-c79c-4f9a-9fc7-8cd5a2dbe679 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:25.679722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0b7b9e39-c79c-4f9a-9fc7-8cd5a2dbe679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:25.697024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:25.825566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b9e39-c79c-4f9a-9fc7-8cd5a2dbe679 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:25.912110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:25.937716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575aa53-0832-4776-af4e-2b66e953f528 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:25.938277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575aa53-0832-4776-af4e-2b66e953f528 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:25.938560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575aa53-0832-4776-af4e-2b66e953f528 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:25.938839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575aa53-0832-4776-af4e-2b66e953f528 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:25.940506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4575aa53-0832-4776-af4e-2b66e953f528 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:26.029575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575aa53-0832-4776-af4e-2b66e953f528 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:26.031175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575aa53-0832-4776-af4e-2b66e953f528 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:26.049057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 711/1434] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:26.846087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9a6e-0d3d-4430-9ce6-f5928121cac8 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:26.847103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9a6e-0d3d-4430-9ce6-f5928121cac8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:26.847103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b9a6e-0d3d-4430-9ce6-f5928121cac8 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:26.848509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:33:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:26.853338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344771-e3db-4e64-bbbf-b0761317aa18 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:26.853769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344771-e3db-4e64-bbbf-b0761317aa18 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:26.854040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09344771-e3db-4e64-bbbf-b0761317aa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:27.052932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-09344771-e3db-4e64-bbbf-b0761317aa18 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:27.054097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-09344771-e3db-4e64-bbbf-b0761317aa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:27.095915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:27.150637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:33:27.299954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b9a6e-0d3d-4430-9ce6-f5928121cac8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:27.301538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7d4b9a6e-0d3d-4430-9ce6-f5928121cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:27.446233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b9a6e-0d3d-4430-9ce6-f5928121cac8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:27.499401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:27.557990 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f3b99-2b85-47dd-856d-3f68d7ec86a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:27.558604 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f3b99-2b85-47dd-856d-3f68d7ec86a6 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:27.558886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f3b99-2b85-47dd-856d-3f68d7ec86a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:27.559154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f3b99-2b85-47dd-856d-3f68d7ec86a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:27.560824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d15f3b99-2b85-47dd-856d-3f68d7ec86a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:27.649574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f3b99-2b85-47dd-856d-3f68d7ec86a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:27.651103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f3b99-2b85-47dd-856d-3f68d7ec86a6 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:27.671248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 725/1437] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:28.463242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad527d-4df3-4346-97cc-425e33c91a80 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:28.463865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad527d-4df3-4346-97cc-425e33c91a80 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:28.463865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad527d-4df3-4346-97cc-425e33c91a80 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:28.465216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:28.469961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079e62d-8b2f-4d2c-b565-b21d59dc2ebe None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:28.470399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079e62d-8b2f-4d2c-b565-b21d59dc2ebe None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:28.470513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079e62d-8b2f-4d2c-b565-b21d59dc2ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:28.548884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9079e62d-8b2f-4d2c-b565-b21d59dc2ebe None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:28.550720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9079e62d-8b2f-4d2c-b565-b21d59dc2ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:28.552726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:28.644615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:28.791824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad527d-4df3-4346-97cc-425e33c91a80 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:28.793348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-01ad527d-4df3-4346-97cc-425e33c91a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:28.933622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad527d-4df3-4346-97cc-425e33c91a80 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:28.960494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:29.046012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57287e0-b30f-464f-9941-653206fff683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:29.046670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57287e0-b30f-464f-9941-653206fff683 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:29.046955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57287e0-b30f-464f-9941-653206fff683 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:29.047229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57287e0-b30f-464f-9941-653206fff683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:29.048898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d57287e0-b30f-464f-9941-653206fff683 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:29.136845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57287e0-b30f-464f-9941-653206fff683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:29.138433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57287e0-b30f-464f-9941-653206fff683 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:29.156888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 714/1440] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:31.060326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4021258-196f-4b97-a3aa-b6fafd684b03 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:31.060868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4021258-196f-4b97-a3aa-b6fafd684b03 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:31.060868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4021258-196f-4b97-a3aa-b6fafd684b03 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:31.062222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:31.068117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc2d0-2d15-40dd-b37d-d406e955b6e1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:31.068634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc2d0-2d15-40dd-b37d-d406e955b6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:31.068734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc2d0-2d15-40dd-b37d-d406e955b6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:31.108327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:31.137018 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0dccc2d0-2d15-40dd-b37d-d406e955b6e1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:31.138232 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0dccc2d0-2d15-40dd-b37d-d406e955b6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:31.233022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:31.271919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4021258-196f-4b97-a3aa-b6fafd684b03 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:31.273492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a4021258-196f-4b97-a3aa-b6fafd684b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:31.373801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4021258-196f-4b97-a3aa-b6fafd684b03 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:31.404636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:31.445683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b675c-0efc-4ceb-ac5d-557861511d82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:31.446297 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b675c-0efc-4ceb-ac5d-557861511d82 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:31.446573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b675c-0efc-4ceb-ac5d-557861511d82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:31.446845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b675c-0efc-4ceb-ac5d-557861511d82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:31.448485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-775b675c-0efc-4ceb-ac5d-557861511d82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:31.556323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b675c-0efc-4ceb-ac5d-557861511d82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:31.557912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775b675c-0efc-4ceb-ac5d-557861511d82 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:31.576913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 728/1443] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:33.729778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ca91-c552-4d48-8cf2-1f43341dbe3f None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:33.730314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ca91-c552-4d48-8cf2-1f43341dbe3f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:33.730434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d43ca91-c552-4d48-8cf2-1f43341dbe3f None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:33.731716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:33.736825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96f283-65ea-4c16-b5a3-48d136f51099 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:33.737878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96f283-65ea-4c16-b5a3-48d136f51099 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:33.737982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96f283-65ea-4c16-b5a3-48d136f51099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:33.926744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4e96f283-65ea-4c16-b5a3-48d136f51099 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:33.927946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4e96f283-65ea-4c16-b5a3-48d136f51099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:33.940244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:34.050660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:34.104574 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ca91-c552-4d48-8cf2-1f43341dbe3f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:34.106158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8d43ca91-c552-4d48-8cf2-1f43341dbe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:34.207930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d43ca91-c552-4d48-8cf2-1f43341dbe3f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:34.220009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:34.285161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc38e8-e0b1-4f80-9473-01f7aa3a83ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:34.285769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc38e8-e0b1-4f80-9473-01f7aa3a83ff service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:34.286045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc38e8-e0b1-4f80-9473-01f7aa3a83ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:34.286310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc38e8-e0b1-4f80-9473-01f7aa3a83ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:34.287911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e6bc38e8-e0b1-4f80-9473-01f7aa3a83ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:34.400534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc38e8-e0b1-4f80-9473-01f7aa3a83ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:34.402170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc38e8-e0b1-4f80-9473-01f7aa3a83ff service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:34.419733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 717/1446] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:36.814739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4089-ee4c-4c25-970a-6c64f6ce086d None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:36.815240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4089-ee4c-4c25-970a-6c64f6ce086d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:36.815354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4089-ee4c-4c25-970a-6c64f6ce086d None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:36.816674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:36.821943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa381-9468-486b-b7e7-b9203a675ce1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:36.822348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa381-9468-486b-b7e7-b9203a675ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:36.822495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249aa381-9468-486b-b7e7-b9203a675ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:36.870579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:36.888394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-249aa381-9468-486b-b7e7-b9203a675ce1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:36.889636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-249aa381-9468-486b-b7e7-b9203a675ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:36.986805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:37.025463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e4089-ee4c-4c25-970a-6c64f6ce086d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:37.027292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-388e4089-ee4c-4c25-970a-6c64f6ce086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:37.128826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e4089-ee4c-4c25-970a-6c64f6ce086d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:37.168139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:37.201526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef25c4e-db95-495d-b5fa-7834586a8dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:37.202136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef25c4e-db95-495d-b5fa-7834586a8dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:37.202412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef25c4e-db95-495d-b5fa-7834586a8dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:37.202677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef25c4e-db95-495d-b5fa-7834586a8dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:37.204326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2ef25c4e-db95-495d-b5fa-7834586a8dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:37.316048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef25c4e-db95-495d-b5fa-7834586a8dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:37.317516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef25c4e-db95-495d-b5fa-7834586a8dc0 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:37.335038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 731/1449] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:39.528819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e26163-01a3-4017-9f36-9839a2681715 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:39.529376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e26163-01a3-4017-9f36-9839a2681715 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:39.529376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e26163-01a3-4017-9f36-9839a2681715 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:39.530737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:39.536446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869af6-f00c-40dc-9d8d-bd84c60249c0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:39.536903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869af6-f00c-40dc-9d8d-bd84c60249c0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:39.537021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27869af6-f00c-40dc-9d8d-bd84c60249c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:39.608400 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-27869af6-f00c-40dc-9d8d-bd84c60249c0 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:39.609603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-27869af6-f00c-40dc-9d8d-bd84c60249c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:39.629750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:39.703977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:39.743848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e26163-01a3-4017-9f36-9839a2681715 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:39.745446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-42e26163-01a3-4017-9f36-9839a2681715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:39.847324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e26163-01a3-4017-9f36-9839a2681715 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:39.867238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:39.921447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf40ee9-5279-41f1-9eac-13152694e446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:39.922062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40ee9-5279-41f1-9eac-13152694e446 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:39.922339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40ee9-5279-41f1-9eac-13152694e446 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:39.922609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf40ee9-5279-41f1-9eac-13152694e446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:39.924256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-acf40ee9-5279-41f1-9eac-13152694e446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:40.031231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf40ee9-5279-41f1-9eac-13152694e446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:40.032698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf40ee9-5279-41f1-9eac-13152694e446 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:40.051420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 720/1452] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:42.140792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff093fc-e9e4-4d76-8dc0-718252417c0c None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:42.141300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff093fc-e9e4-4d76-8dc0-718252417c0c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:42.141300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff093fc-e9e4-4d76-8dc0-718252417c0c None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:42.142604 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:42.147833 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bb82d-61a4-486c-a766-485d91c07784 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:42.148239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bb82d-61a4-486c-a766-485d91c07784 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:42.148409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bb82d-61a4-486c-a766-485d91c07784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:42.211947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:42.214847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4a8bb82d-61a4-486c-a766-485d91c07784 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:42.216621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4a8bb82d-61a4-486c-a766-485d91c07784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:42.313071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:42.351768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff093fc-e9e4-4d76-8dc0-718252417c0c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:42.353375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bff093fc-e9e4-4d76-8dc0-718252417c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:42.454841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff093fc-e9e4-4d76-8dc0-718252417c0c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:42.502624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:42.526349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a017dc4-1763-40b7-ab44-a79ecc702b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:42.526960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a017dc4-1763-40b7-ab44-a79ecc702b77 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:42.527487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a017dc4-1763-40b7-ab44-a79ecc702b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:42.527756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a017dc4-1763-40b7-ab44-a79ecc702b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:42.529419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1a017dc4-1763-40b7-ab44-a79ecc702b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:42.637349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a017dc4-1763-40b7-ab44-a79ecc702b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:42.638777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a017dc4-1763-40b7-ab44-a79ecc702b77 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:42.656520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 734/1455] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:44.712950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd9712-ee54-4a6a-822b-8a48cc04048b None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:44.713433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd9712-ee54-4a6a-822b-8a48cc04048b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:44.713525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd9712-ee54-4a6a-822b-8a48cc04048b None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:44.714864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:44.720182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68f756-0f1d-44f0-ab1c-5fb7cf70f4ae None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:44.720627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68f756-0f1d-44f0-ab1c-5fb7cf70f4ae None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:44.720726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68f756-0f1d-44f0-ab1c-5fb7cf70f4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:44.788084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2f68f756-0f1d-44f0-ab1c-5fb7cf70f4ae None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:44.789325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2f68f756-0f1d-44f0-ab1c-5fb7cf70f4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:44.818159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:44.885054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:44.923230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd9712-ee54-4a6a-822b-8a48cc04048b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:44.924899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-06fd9712-ee54-4a6a-822b-8a48cc04048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:45.027017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd9712-ee54-4a6a-822b-8a48cc04048b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:45.054505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:45.098996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211dcf5b-ee59-476a-801c-f907a2746a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:45.099612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dcf5b-ee59-476a-801c-f907a2746a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:45.099892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dcf5b-ee59-476a-801c-f907a2746a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:45.100184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211dcf5b-ee59-476a-801c-f907a2746a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:45.101810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-211dcf5b-ee59-476a-801c-f907a2746a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:45.210819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dcf5b-ee59-476a-801c-f907a2746a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:45.212186 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211dcf5b-ee59-476a-801c-f907a2746a55 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:45.230346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 723/1458] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:47.333431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176970-18d6-4d67-9964-ec66b7bd8bac None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:47.334000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176970-18d6-4d67-9964-ec66b7bd8bac None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:47.334000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176970-18d6-4d67-9964-ec66b7bd8bac None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:47.335308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:47.340650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81502b1b-1964-4afc-9c8a-f715c973c686 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:47.341058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81502b1b-1964-4afc-9c8a-f715c973c686 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:47.341173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81502b1b-1964-4afc-9c8a-f715c973c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:47.405077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-81502b1b-1964-4afc-9c8a-f715c973c686 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:47.406263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-81502b1b-1964-4afc-9c8a-f715c973c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:47.414263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:47.500939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:47.538531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23176970-18d6-4d67-9964-ec66b7bd8bac None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:47.540074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-23176970-18d6-4d67-9964-ec66b7bd8bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:47.641486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23176970-18d6-4d67-9964-ec66b7bd8bac None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:47.695234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:47.712960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0979ab-476f-4e43-961c-6711bfc41053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:47.713575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0979ab-476f-4e43-961c-6711bfc41053 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:47.713856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0979ab-476f-4e43-961c-6711bfc41053 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:47.714157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0979ab-476f-4e43-961c-6711bfc41053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:47.715864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8b0979ab-476f-4e43-961c-6711bfc41053 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:47.823988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0979ab-476f-4e43-961c-6711bfc41053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:47.825481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0979ab-476f-4e43-961c-6711bfc41053 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:47.843077 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 737/1461] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:49.853544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db41f-8bda-42e0-af51-fa8b960776af None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:49.854046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db41f-8bda-42e0-af51-fa8b960776af None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:49.854158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4db41f-8bda-42e0-af51-fa8b960776af None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:49.855428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:49.860533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1bf0a-31a5-4857-bcc1-d12bac085bf7 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:49.860932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1bf0a-31a5-4857-bcc1-d12bac085bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:49.861076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e1bf0a-31a5-4857-bcc1-d12bac085bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:49.925203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f4e1bf0a-31a5-4857-bcc1-d12bac085bf7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:49.926391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f4e1bf0a-31a5-4857-bcc1-d12bac085bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:49.962772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:50.026394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:50.062489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db41f-8bda-42e0-af51-fa8b960776af None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:50.064028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3a4db41f-8bda-42e0-af51-fa8b960776af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:50.166546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4db41f-8bda-42e0-af51-fa8b960776af None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:50.203207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:50.238344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59261fc9-dd0e-4235-bc5b-a1826fbf301e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:50.238950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59261fc9-dd0e-4235-bc5b-a1826fbf301e service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:50.239234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59261fc9-dd0e-4235-bc5b-a1826fbf301e service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:50.239507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59261fc9-dd0e-4235-bc5b-a1826fbf301e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:50.241148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-59261fc9-dd0e-4235-bc5b-a1826fbf301e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:50.352081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59261fc9-dd0e-4235-bc5b-a1826fbf301e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:50.353454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59261fc9-dd0e-4235-bc5b-a1826fbf301e service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:50.371325 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 726/1464] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:52.375462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d653-e767-4dcd-8fec-bc6dc4e4b783 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:52.376014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d653-e767-4dcd-8fec-bc6dc4e4b783 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:52.376014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916d653-e767-4dcd-8fec-bc6dc4e4b783 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:52.377388 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:52.382532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4f71a-4d29-4e2c-a846-89787a814814 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:52.382907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4f71a-4d29-4e2c-a846-89787a814814 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:52.383083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4f71a-4d29-4e2c-a846-89787a814814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:52.447899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-aac4f71a-4d29-4e2c-a846-89787a814814 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:52.449131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aac4f71a-4d29-4e2c-a846-89787a814814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:52.466599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:52.545350 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:52.582684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d653-e767-4dcd-8fec-bc6dc4e4b783 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:52.584964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8916d653-e767-4dcd-8fec-bc6dc4e4b783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:52.697103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916d653-e767-4dcd-8fec-bc6dc4e4b783 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:52.761401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:52.768978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c14d8-ec1f-4b0e-8185-7911902a2656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:52.769593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c14d8-ec1f-4b0e-8185-7911902a2656 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:52.769873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c14d8-ec1f-4b0e-8185-7911902a2656 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:52.770146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c14d8-ec1f-4b0e-8185-7911902a2656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:52.771785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cc5c14d8-ec1f-4b0e-8185-7911902a2656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:52.878269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c14d8-ec1f-4b0e-8185-7911902a2656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:52.879698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c14d8-ec1f-4b0e-8185-7911902a2656 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:52.897565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 740/1467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:33:54.927397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5472d-d468-45d9-abb8-e5ec677d33af None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:54.927922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5472d-d468-45d9-abb8-e5ec677d33af None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:54.927922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5472d-d468-45d9-abb8-e5ec677d33af None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:54.929277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:33:54.934967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac41c6-6651-4a9c-9e00-a13f0bd34ea2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:54.935444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac41c6-6651-4a9c-9e00-a13f0bd34ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:54.935572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ac41c6-6651-4a9c-9e00-a13f0bd34ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:55.000380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-95ac41c6-6651-4a9c-9e00-a13f0bd34ea2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:55.001574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-95ac41c6-6651-4a9c-9e00-a13f0bd34ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:55.048824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:55.097486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:33:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:55.134440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5472d-d468-45d9-abb8-e5ec677d33af None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:55.135975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1ea5472d-d468-45d9-abb8-e5ec677d33af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:55.237918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5472d-d468-45d9-abb8-e5ec677d33af None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:55.283603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:55.309979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833e401-7961-4cf1-89cb-d8686eec4911 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:55.310583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e401-7961-4cf1-89cb-d8686eec4911 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:55.310857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e401-7961-4cf1-89cb-d8686eec4911 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:55.311123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e401-7961-4cf1-89cb-d8686eec4911 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:55.312746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9833e401-7961-4cf1-89cb-d8686eec4911 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:55.421430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833e401-7961-4cf1-89cb-d8686eec4911 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:55.422855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833e401-7961-4cf1-89cb-d8686eec4911 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:55.441589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 729/1470] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:34:05.095555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=22 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:05.439288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=66 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:14.990438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d466561-4f04-4bb1-b7ec-81d58348654f None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:14.990993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d466561-4f04-4bb1-b7ec-81d58348654f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:14.990993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d466561-4f04-4bb1-b7ec-81d58348654f None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:14.992308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 742/1471] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:14.998581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309060f-bc76-4686-b071-a181c4280436 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:14.999019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309060f-bc76-4686-b071-a181c4280436 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:14.999137 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0309060f-bc76-4686-b071-a181c4280436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:15.063195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0309060f-bc76-4686-b071-a181c4280436 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:15.064404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0309060f-bc76-4686-b071-a181c4280436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:15.162292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 730/1472] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:34:15.243594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49833b-943c-4d46-8492-7020ab906d60 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:15.243826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49833b-943c-4d46-8492-7020ab906d60 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:15.244111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49833b-943c-4d46-8492-7020ab906d60 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:15.245467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 743/1473] 10.222.0.57 () {54 vars in 966 bytes} [Tue Aug 2 21:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:15.250468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3f62-7566-4818-9a64-8c3f6029937f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:15.250754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3f62-7566-4818-9a64-8c3f6029937f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:15.251057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb3f62-7566-4818-9a64-8c3f6029937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:15.325897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b2eb3f62-7566-4818-9a64-8c3f6029937f None None] MFA Rules not processed for user `4e3cd62eb975492aab4a136c0e9825a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:15.327094 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b2eb3f62-7566-4818-9a64-8c3f6029937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:15.348123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:15.403511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 731/1474] 10.222.0.57 () {58 vars in 1063 bytes} [Tue Aug 2 21:34:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:15.411633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49833b-943c-4d46-8492-7020ab906d60 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:15.413225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-da49833b-943c-4d46-8492-7020ab906d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:15.513789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49833b-943c-4d46-8492-7020ab906d60 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:15.586364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f6e45-f532-48be-898b-805e00246e90 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cd62eb975492aab4a136c0e9825a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:15.586981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f6e45-f532-48be-898b-805e00246e90 service glance] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:15.587283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f6e45-f532-48be-898b-805e00246e90 service glance] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:15.587551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f6e45-f532-48be-898b-805e00246e90 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:15.589204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-338f6e45-f532-48be-898b-805e00246e90 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:15.640608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:15.694086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f6e45-f532-48be-898b-805e00246e90 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:15.695512 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f6e45-f532-48be-898b-805e00246e90 service glance] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:15.713925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 744/1475] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:17.763239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c2953-b35c-4e33-83b9-61fce6a4a15d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:17.763814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c2953-b35c-4e33-83b9-61fce6a4a15d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:17.763814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c2953-b35c-4e33-83b9-61fce6a4a15d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:17.765186 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 732/1476] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:17.770220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230be04-887a-4a4b-a5aa-cb2edb17151f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:17.770608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230be04-887a-4a4b-a5aa-cb2edb17151f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:17.770767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230be04-887a-4a4b-a5aa-cb2edb17151f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:17.835463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a230be04-887a-4a4b-a5aa-cb2edb17151f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:17.836702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a230be04-887a-4a4b-a5aa-cb2edb17151f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:17.932158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 745/1477] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:17.954463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c2953-b35c-4e33-83b9-61fce6a4a15d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:17.955988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4c5c2953-b35c-4e33-83b9-61fce6a4a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:18.087032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c2953-b35c-4e33-83b9-61fce6a4a15d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:18.134433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:18.179227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2dc37-48f8-4499-a5ac-6e88743626b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:18.179903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2dc37-48f8-4499-a5ac-6e88743626b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:18.180212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2dc37-48f8-4499-a5ac-6e88743626b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:18.180517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2dc37-48f8-4499-a5ac-6e88743626b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:18.181210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2dc37-48f8-4499-a5ac-6e88743626b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:18.182951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING py.warnings [None req-dbd2dc37-48f8-4499-a5ac-6e88743626b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:34:18.182951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: warnings.warn(msg) Aug 02 21:34:18.182951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: Aug 02 21:34:18.184108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2dc37-48f8-4499-a5ac-6e88743626b5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:18.202514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 733/1478] 10.222.0.57 () {56 vars in 1108 bytes} [Tue Aug 2 21:34:17 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:34:20.203096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689a576-3200-4612-baed-4665d3b34307 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:20.203629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689a576-3200-4612-baed-4665d3b34307 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:20.203629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689a576-3200-4612-baed-4665d3b34307 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:20.204939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 746/1479] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:20.210637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cef87-5c9a-41f7-8952-2d520554e975 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:20.211060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cef87-5c9a-41f7-8952-2d520554e975 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:20.211239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8cef87-5c9a-41f7-8952-2d520554e975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:20.275857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6e8cef87-5c9a-41f7-8952-2d520554e975 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:20.277075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6e8cef87-5c9a-41f7-8952-2d520554e975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:20.370786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 734/1480] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:20.413343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689a576-3200-4612-baed-4665d3b34307 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:20.414978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2689a576-3200-4612-baed-4665d3b34307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:20.425575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:20.559796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689a576-3200-4612-baed-4665d3b34307 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:20.637759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:20.670040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68aa5d-84cf-4d9f-82cb-88252fd25995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:20.670650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68aa5d-84cf-4d9f-82cb-88252fd25995 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:20.670932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68aa5d-84cf-4d9f-82cb-88252fd25995 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:20.671202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68aa5d-84cf-4d9f-82cb-88252fd25995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:20.672894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7a68aa5d-84cf-4d9f-82cb-88252fd25995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:20.763299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68aa5d-84cf-4d9f-82cb-88252fd25995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:20.764940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68aa5d-84cf-4d9f-82cb-88252fd25995 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:20.783092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 747/1481] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:22.948672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1431cb-1456-4cec-81b4-ebdac6872c41 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:22.949181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1431cb-1456-4cec-81b4-ebdac6872c41 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:22.949181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1431cb-1456-4cec-81b4-ebdac6872c41 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:22.950509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 735/1482] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:22.956111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1bee4-04a7-4999-a5dd-c884e375f3f9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:22.956530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1bee4-04a7-4999-a5dd-c884e375f3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:22.956687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1bee4-04a7-4999-a5dd-c884e375f3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:23.021129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-76a1bee4-04a7-4999-a5dd-c884e375f3f9 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:23.022326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-76a1bee4-04a7-4999-a5dd-c884e375f3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:23.069797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:23.119316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 748/1483] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:23.156722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1431cb-1456-4cec-81b4-ebdac6872c41 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:23.158324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dd1431cb-1456-4cec-81b4-ebdac6872c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:23.181051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:23.258916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1431cb-1456-4cec-81b4-ebdac6872c41 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:23.329454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437c5952-bd0e-41a7-a696-696d5901e9ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:23.330055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c5952-bd0e-41a7-a696-696d5901e9ab service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:23.330889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c5952-bd0e-41a7-a696-696d5901e9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:23.331157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437c5952-bd0e-41a7-a696-696d5901e9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:23.332798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-437c5952-bd0e-41a7-a696-696d5901e9ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:23.416670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:23.453119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c5952-bd0e-41a7-a696-696d5901e9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:23.454542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437c5952-bd0e-41a7-a696-696d5901e9ab service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:23.472040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 736/1484] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:25.540213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace3e5-c92d-454d-9d63-9bf23e2cc3f2 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:25.540796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace3e5-c92d-454d-9d63-9bf23e2cc3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:25.540796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ace3e5-c92d-454d-9d63-9bf23e2cc3f2 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:25.542151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 749/1485] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:25.547636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68c513-8f42-44c2-b7f7-adbe2d46fb2e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:25.548055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68c513-8f42-44c2-b7f7-adbe2d46fb2e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:25.548223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68c513-8f42-44c2-b7f7-adbe2d46fb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:25.613317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-de68c513-8f42-44c2-b7f7-adbe2d46fb2e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:25.614525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-de68c513-8f42-44c2-b7f7-adbe2d46fb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:25.719711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 737/1486] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:25.758143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace3e5-c92d-454d-9d63-9bf23e2cc3f2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:25.759695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d0ace3e5-c92d-454d-9d63-9bf23e2cc3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:25.864370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ace3e5-c92d-454d-9d63-9bf23e2cc3f2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:25.935107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:25.937034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43abd6-88f7-4b59-965d-a9f48d3d4d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:25.937628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43abd6-88f7-4b59-965d-a9f48d3d4d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:25.938175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43abd6-88f7-4b59-965d-a9f48d3d4d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:25.938641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43abd6-88f7-4b59-965d-a9f48d3d4d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:25.940598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ea43abd6-88f7-4b59-965d-a9f48d3d4d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:26.047407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43abd6-88f7-4b59-965d-a9f48d3d4d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:26.048879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea43abd6-88f7-4b59-965d-a9f48d3d4d41 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:26.066831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 750/1487] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:28.248157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124e48c-ea19-4690-84b3-8032893b2426 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:28.248811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124e48c-ea19-4690-84b3-8032893b2426 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:28.248811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124e48c-ea19-4690-84b3-8032893b2426 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:28.250165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 738/1488] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:28.255336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3794d-6de6-4c2a-b6ff-40cfc5fb0b30 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:28.255776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3794d-6de6-4c2a-b6ff-40cfc5fb0b30 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:28.255903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3794d-6de6-4c2a-b6ff-40cfc5fb0b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:28.320376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8ef3794d-6de6-4c2a-b6ff-40cfc5fb0b30 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:28.321581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8ef3794d-6de6-4c2a-b6ff-40cfc5fb0b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:28.372595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:28.416603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 751/1489] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:28.456722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124e48c-ea19-4690-84b3-8032893b2426 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:28.458233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e124e48c-ea19-4690-84b3-8032893b2426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:28.493973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:28.561733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124e48c-ea19-4690-84b3-8032893b2426 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:28.632923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0fdfc-1677-4951-be57-f57df88967c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:28.633524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0fdfc-1677-4951-be57-f57df88967c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:28.633800 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0fdfc-1677-4951-be57-f57df88967c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:28.634070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0fdfc-1677-4951-be57-f57df88967c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:28.635661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5fb0fdfc-1677-4951-be57-f57df88967c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:28.716761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:28.746276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0fdfc-1677-4951-be57-f57df88967c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:28.747710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0fdfc-1677-4951-be57-f57df88967c7 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:28.767082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 739/1490] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:30.988169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bd4e-03f1-497f-bde5-ac7a1ffe18c4 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:30.988706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bd4e-03f1-497f-bde5-ac7a1ffe18c4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:30.988706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bd4e-03f1-497f-bde5-ac7a1ffe18c4 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:30.989944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 752/1491] 10.222.0.57 () {54 vars in 926 bytes} [Tue Aug 2 21:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:30.995101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c032e-0861-41b4-83fe-3ce964cedc95 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:30.995526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c032e-0861-41b4-83fe-3ce964cedc95 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:30.995660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c032e-0861-41b4-83fe-3ce964cedc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:31.063572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-800c032e-0861-41b4-83fe-3ce964cedc95 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:31.065440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-800c032e-0861-41b4-83fe-3ce964cedc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:31.161958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 740/1492] 10.222.0.57 () {58 vars in 1023 bytes} [Tue Aug 2 21:34:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:31.201153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611bd4e-03f1-497f-bde5-ac7a1ffe18c4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:31.202691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2611bd4e-03f1-497f-bde5-ac7a1ffe18c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:31.304963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611bd4e-03f1-497f-bde5-ac7a1ffe18c4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:31.376029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5506e-ae7d-4e90-be96-fcf5d5040ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:31.376670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5506e-ae7d-4e90-be96-fcf5d5040ded service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:31.376953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5506e-ae7d-4e90-be96-fcf5d5040ded service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:31.377230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5506e-ae7d-4e90-be96-fcf5d5040ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:31.378860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0cb5506e-ae7d-4e90-be96-fcf5d5040ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:31.387859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:31.487961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5506e-ae7d-4e90-be96-fcf5d5040ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:31.490014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5506e-ae7d-4e90-be96-fcf5d5040ded service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:31.507495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 753/1493] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:41.160102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=82 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:41.505303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=50 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:15.809367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da85ed-a436-4bd6-98a1-d0ede53cffe3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:15.809843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da85ed-a436-4bd6-98a1-d0ede53cffe3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:15.809963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da85ed-a436-4bd6-98a1-d0ede53cffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:15.884878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-14da85ed-a436-4bd6-98a1-d0ede53cffe3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:36:15.886076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-14da85ed-a436-4bd6-98a1-d0ede53cffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:15.982072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 741/1494] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:36:15.990434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b459c58-3d50-43e5-afa8-7b0b0389aa09 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:15.990956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b459c58-3d50-43e5-afa8-7b0b0389aa09 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:15.991170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b459c58-3d50-43e5-afa8-7b0b0389aa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:16.065707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1b459c58-3d50-43e5-afa8-7b0b0389aa09 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:36:16.066850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1b459c58-3d50-43e5-afa8-7b0b0389aa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:16.161595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 754/1495] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:36:16.166362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da85ed-a436-4bd6-98a1-d0ede53cffe3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:16.167573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-14da85ed-a436-4bd6-98a1-d0ede53cffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:16.179365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da85ed-a436-4bd6-98a1-d0ede53cffe3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:16.245419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:16.278928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:16.279926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:16.280752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:16.281030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:16.281719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:36:16.282024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:16.283026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING py.warnings [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:36:16.283026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: warnings.warn(msg) Aug 02 21:36:16.283026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: Aug 02 21:36:16.283902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:16.295047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 742/1496] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:36:16.304369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b459c58-3d50-43e5-afa8-7b0b0389aa09 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:16.313480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b459c58-3d50-43e5-afa8-7b0b0389aa09 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:16.373267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:16.406972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:16.407581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:16.407856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:16.408123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:16.408802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:16.410526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: WARNING py.warnings [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:36:16.410526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: warnings.warn(msg) Aug 02 21:36:16.410526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: Aug 02 21:36:16.411701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:16.465511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 755/1497] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:36:16 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:36:16.470205 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:16.471757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:16.505633 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af404b1-cf45-4248-af09-47e6a1696fb6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:16.601559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:16.602173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:16.602449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:16.602717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:16.603372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:16.604412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING py.warnings [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:36:16.604412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: warnings.warn(msg) Aug 02 21:36:16.604412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: Aug 02 21:36:16.605620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:16.646575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 743/1498] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:36:16 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:36:16.650658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:16.652225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:16.711864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5d615-e547-48f7-b005-3f66940ee106 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:16.794498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:16.808519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:16.809140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:16.809423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:16.809693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:16.810387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:16.811392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: WARNING py.warnings [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:36:16.811392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: warnings.warn(msg) Aug 02 21:36:16.811392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: Aug 02 21:36:16.812967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:16.825215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 756/1499] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:36:16.829431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:16.830987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:16.842353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4f468-c9b2-4944-8d23-545de506e339 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:16.867395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:16.938182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05317d6-34bd-43dc-9d79-326ee7bf404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:16.938724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05317d6-34bd-43dc-9d79-326ee7bf404a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:16.939017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05317d6-34bd-43dc-9d79-326ee7bf404a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:16.939288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05317d6-34bd-43dc-9d79-326ee7bf404a admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:16.939978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05317d6-34bd-43dc-9d79-326ee7bf404a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:16.941022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING py.warnings [None req-f05317d6-34bd-43dc-9d79-326ee7bf404a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:36:16.941022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: warnings.warn(msg) Aug 02 21:36:16.941022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: Aug 02 21:36:16.941901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05317d6-34bd-43dc-9d79-326ee7bf404a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:16.954144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 744/1500] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:36:16.958540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:16.960069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:16.993333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ecc61-9715-4cdb-8066-7eafe2974503 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:17.085340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e00538-ef8c-4aae-948b-566af177dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:17.086002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e00538-ef8c-4aae-948b-566af177dd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:17.086310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e00538-ef8c-4aae-948b-566af177dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:17.086582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e00538-ef8c-4aae-948b-566af177dd5e admin admin] PATH_INFO: `/v3/projects/ea79dc69671442b6a508439b78a6cbec/users/8e40e7e1c5954f0b931de62a60f1155c/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:17.108083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e00538-ef8c-4aae-948b-566af177dd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea79dc69671442b6a508439b78a6cbec, user_id=8e40e7e1c5954f0b931de62a60f1155c, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:17.109723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: WARNING py.warnings [None req-a7e00538-ef8c-4aae-948b-566af177dd5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:36:17.109723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: warnings.warn(msg) Aug 02 21:36:17.109723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: Aug 02 21:36:17.111648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e00538-ef8c-4aae-948b-566af177dd5e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:17.135510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 757/1501] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:36:16 2022] PUT /identity/v3/projects/ea79dc69671442b6a508439b78a6cbec/users/8e40e7e1c5954f0b931de62a60f1155c/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:36:17.147576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a46dfc-34a4-407f-9f2b-e1941bf1ac42 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:17.147869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a46dfc-34a4-407f-9f2b-e1941bf1ac42 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:17.148173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a46dfc-34a4-407f-9f2b-e1941bf1ac42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:17.207201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c2a46dfc-34a4-407f-9f2b-e1941bf1ac42 None None] MFA Rules not processed for user `8e40e7e1c5954f0b931de62a60f1155c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:36:17.208445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c2a46dfc-34a4-407f-9f2b-e1941bf1ac42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:17.291750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 745/1502] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:36:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:36:17.305584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ff90-8d83-415f-b462-788fbaa32356 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:17.305881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ff90-8d83-415f-b462-788fbaa32356 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:17.306157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ff90-8d83-415f-b462-788fbaa32356 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:17.307483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 758/1503] 10.222.0.57 () {54 vars in 964 bytes} [Tue Aug 2 21:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:36:17.312242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e920a1-3480-4cb6-88a3-ef53bdda7b9f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:17.312531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e920a1-3480-4cb6-88a3-ef53bdda7b9f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:17.312806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e920a1-3480-4cb6-88a3-ef53bdda7b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:17.343913 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:17.388560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f4e920a1-3480-4cb6-88a3-ef53bdda7b9f None None] MFA Rules not processed for user `124c246d00a841608a2bc4f5230f4eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:36:17.389769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f4e920a1-3480-4cb6-88a3-ef53bdda7b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:17.463485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 746/1504] 10.222.0.57 () {58 vars in 1061 bytes} [Tue Aug 2 21:36:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:36:17.471104 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ff90-8d83-415f-b462-788fbaa32356 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:17.472686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2c75ff90-8d83-415f-b462-788fbaa32356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:17.521933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:17.577366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ff90-8d83-415f-b462-788fbaa32356 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:17.649520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:17.650129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:17.650411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:17.650686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:17.652348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:17.747895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:17.749325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:17.752750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:17.767658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 759/1505] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:36:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:36:17.812870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe20fb5-2a09-4d3c-950f-b5326273ca66 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:17.813161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe20fb5-2a09-4d3c-950f-b5326273ca66 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:17.813440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe20fb5-2a09-4d3c-950f-b5326273ca66 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:17.814713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 747/1506] 10.222.0.57 () {52 vars in 830 bytes} [Tue Aug 2 21:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:36:17.818318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:17.819569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:17.919011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbcc93-9333-418b-baa6-bfbbcdf4f931 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:18.013362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:18.013982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:18.014195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:18.014467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] PATH_INFO: `/v3/users/8e40e7e1c5954f0b931de62a60f1155c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:18.026450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e40e7e1c5954f0b931de62a60f1155c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:18.027480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: WARNING py.warnings [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:36:18.027480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: warnings.warn(msg) Aug 02 21:36:18.027480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: Aug 02 21:36:18.028729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:18.038950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:18.099683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e40e7e1c5954f0b931de62a60f1155c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:18.122408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e40e7e1c5954f0b931de62a60f1155c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:18.136513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e40e7e1c5954f0b931de62a60f1155c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:18.137094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e40e7e1c5954f0b931de62a60f1155c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:18.137603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e40e7e1c5954f0b931de62a60f1155c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:18.152628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 760/1507] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:36:17 2022] DELETE /identity/v3/users/8e40e7e1c5954f0b931de62a60f1155c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:36:18.158036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde97ee-4562-498d-9915-0e6e68a988c7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:18.158560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde97ee-4562-498d-9915-0e6e68a988c7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:18.158560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde97ee-4562-498d-9915-0e6e68a988c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:18.213105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4dde97ee-4562-498d-9915-0e6e68a988c7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:36:18.214293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4dde97ee-4562-498d-9915-0e6e68a988c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:18.288727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:18.302421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 748/1508] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:36:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:36:18.312711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:18.313933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:18.409649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0d2a2-eaf6-4a39-a184-221a4daf84a7 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:18.463139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:18.483875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e498e-f4ff-4d6a-a136-dd9815e94cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:18.484563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e498e-f4ff-4d6a-a136-dd9815e94cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:18.484846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e498e-f4ff-4d6a-a136-dd9815e94cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:18.485123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e498e-f4ff-4d6a-a136-dd9815e94cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:18.486758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5a7e498e-f4ff-4d6a-a136-dd9815e94cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:18.593946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e498e-f4ff-4d6a-a136-dd9815e94cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:18.595329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e498e-f4ff-4d6a-a136-dd9815e94cc0 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:18.614142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 761/1509] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:36:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:36:18.940091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde97ee-4562-498d-9915-0e6e68a988c7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:36:18.941886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4dde97ee-4562-498d-9915-0e6e68a988c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:36:18.957423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde97ee-4562-498d-9915-0e6e68a988c7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:36:19.055175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:36:19.055818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:36:19.056104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:36:19.056406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] PATH_INFO: `/v3/projects/ea79dc69671442b6a508439b78a6cbec` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:36:19.066194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea79dc69671442b6a508439b78a6cbec)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:36:19.067221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING py.warnings [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:36:19.067221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: warnings.warn(msg) Aug 02 21:36:19.067221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: Aug 02 21:36:19.068452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:36:19.125298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea79dc69671442b6a508439b78a6cbec', 'request_id': 'req-16e4e160-4721-4cb3-a67d-e7c58eb647e4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:19.134036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea79dc69671442b6a508439b78a6cbec', 'request_id': 'req-16e4e160-4721-4cb3-a67d-e7c58eb647e4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:19.147792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea79dc69671442b6a508439b78a6cbec', 'request_id': 'req-16e4e160-4721-4cb3-a67d-e7c58eb647e4'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:19.170275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] The token cache is being invalidate because project ea79dc69671442b6a508439b78a6cbec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:36:19.171358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:19.172153 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-16e4e160-4721-4cb3-a67d-e7c58eb647e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:36:19.173501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 749/1510] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:36:18 2022] DELETE /identity/v3/projects/ea79dc69671442b6a508439b78a6cbec => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:36:28.611832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=62 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:36:29.168291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:58.087560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134d307-c9b7-4636-9ff8-d7cd47692104 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:58.088198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134d307-c9b7-4636-9ff8-d7cd47692104 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:58.088198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0134d307-c9b7-4636-9ff8-d7cd47692104 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:58.089541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:37:58.094503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79382-990e-489b-9df1-7e0e06de122b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:58.094916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79382-990e-489b-9df1-7e0e06de122b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:58.095038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f79382-990e-489b-9df1-7e0e06de122b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:58.180386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e1f79382-990e-489b-9df1-7e0e06de122b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:37:58.182293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e1f79382-990e-489b-9df1-7e0e06de122b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:58.287465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:37:58.443988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134d307-c9b7-4636-9ff8-d7cd47692104 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:58.446122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0134d307-c9b7-4636-9ff8-d7cd47692104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:58.562730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0134d307-c9b7-4636-9ff8-d7cd47692104 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:58.568089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfdfbf-21c7-4cf2-9ec1-fff2c79567e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:58.568719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfdfbf-21c7-4cf2-9ec1-fff2c79567e2 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:58.568996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfdfbf-21c7-4cf2-9ec1-fff2c79567e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:58.569267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfdfbf-21c7-4cf2-9ec1-fff2c79567e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:58.577462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfdfbf-21c7-4cf2-9ec1-fff2c79567e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:58.579093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfdfbf-21c7-4cf2-9ec1-fff2c79567e2 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:58.589026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 763/1513] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:37:59.409148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a41c5-d881-424a-8dac-cb8a801676b0 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:59.409711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a41c5-d881-424a-8dac-cb8a801676b0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:59.409711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a41c5-d881-424a-8dac-cb8a801676b0 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:59.411120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:37:59.416483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2654c-6058-4de1-ae57-20b7c737b23a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:59.416877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2654c-6058-4de1-ae57-20b7c737b23a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:59.417032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2654c-6058-4de1-ae57-20b7c737b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:59.436939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1fe2654c-6058-4de1-ae57-20b7c737b23a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:37:59.438157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1fe2654c-6058-4de1-ae57-20b7c737b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:59.445999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:37:59.594150 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a41c5-d881-424a-8dac-cb8a801676b0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:59.608890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a41c5-d881-424a-8dac-cb8a801676b0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:59.614222 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125933cd-f598-4144-abb7-a7ae73642ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:59.614817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125933cd-f598-4144-abb7-a7ae73642ad6 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:59.615098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125933cd-f598-4144-abb7-a7ae73642ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:59.615384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125933cd-f598-4144-abb7-a7ae73642ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:59.623922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125933cd-f598-4144-abb7-a7ae73642ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:59.625520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125933cd-f598-4144-abb7-a7ae73642ad6 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:59.634791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 752/1516] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:37:59.966938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6039754-6095-4531-8959-8ffc1b713294 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:59.967231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6039754-6095-4531-8959-8ffc1b713294 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:59.967505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6039754-6095-4531-8959-8ffc1b713294 None None] PATH_INFO: `/v3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:59.969076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 765/1517] 10.222.0.46 () {54 vars in 925 bytes} [Tue Aug 2 21:37:59 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:37:59.975161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e981d3-f869-4935-865a-4036645444b4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:59.975447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e981d3-f869-4935-865a-4036645444b4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:59.975727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e981d3-f869-4935-865a-4036645444b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:00.035561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a8e981d3-f869-4935-865a-4036645444b4 None None] MFA Rules not processed for user `ad52cba0b761482d96b6659654034ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:00.036824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a8e981d3-f869-4935-865a-4036645444b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:00.054184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:38:00.111749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 753/1518] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Aug 2 21:37:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:38:09.053781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5e44b-4613-4f49-90ad-16f188c9a539 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:09.054349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5e44b-4613-4f49-90ad-16f188c9a539 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:09.054349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5e44b-4613-4f49-90ad-16f188c9a539 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:09.055668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 766/1519] 10.222.0.57 () {54 vars in 961 bytes} [Tue Aug 2 21:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:38:09.060951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53410a-4db2-4ffb-bebb-3e57d0ff0f59 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:09.061356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53410a-4db2-4ffb-bebb-3e57d0ff0f59 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:09.061505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53410a-4db2-4ffb-bebb-3e57d0ff0f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:09.081007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ee53410a-4db2-4ffb-bebb-3e57d0ff0f59 None None] MFA Rules not processed for user `ad52cba0b761482d96b6659654034ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:09.082191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ee53410a-4db2-4ffb-bebb-3e57d0ff0f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:09.091513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 754/1520] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Aug 2 21:38:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:38:09.098794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5e44b-4613-4f49-90ad-16f188c9a539 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:38:09.112707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5e44b-4613-4f49-90ad-16f188c9a539 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:38:09.117575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c0fd5-e8d4-4ebb-99ed-cd5d2a0be08a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:38:09.118225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c0fd5-e8d4-4ebb-99ed-cd5d2a0be08a service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:09.118517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c0fd5-e8d4-4ebb-99ed-cd5d2a0be08a service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:09.118793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c0fd5-e8d4-4ebb-99ed-cd5d2a0be08a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:09.126903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c0fd5-e8d4-4ebb-99ed-cd5d2a0be08a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:38:09.128520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c0fd5-e8d4-4ebb-99ed-cd5d2a0be08a service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:38:09.138476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 767/1521] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:38:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:38:10.829813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f6f0d-6bd9-4dfc-9954-71cdf8811c0a None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:10.830274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f6f0d-6bd9-4dfc-9954-71cdf8811c0a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:10.830383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f6f0d-6bd9-4dfc-9954-71cdf8811c0a None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:10.832026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:38:10.837038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917e660-b2b7-4686-9e1b-677536e70f3e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:10.838164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917e660-b2b7-4686-9e1b-677536e70f3e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:10.838271 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917e660-b2b7-4686-9e1b-677536e70f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:10.858107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a917e660-b2b7-4686-9e1b-677536e70f3e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:10.859408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a917e660-b2b7-4686-9e1b-677536e70f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:10.867426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:38:11.021906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f6f0d-6bd9-4dfc-9954-71cdf8811c0a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:38:11.039510 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f6f0d-6bd9-4dfc-9954-71cdf8811c0a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:38:11.045098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a1caa-0f8d-4941-93b5-5d1b6024b08a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:38:11.046053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a1caa-0f8d-4941-93b5-5d1b6024b08a service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:11.046561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a1caa-0f8d-4941-93b5-5d1b6024b08a service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:11.047012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a1caa-0f8d-4941-93b5-5d1b6024b08a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:11.060107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a1caa-0f8d-4941-93b5-5d1b6024b08a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:38:11.062603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a1caa-0f8d-4941-93b5-5d1b6024b08a service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:38:11.077448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 756/1524] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:38:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:38:11.890175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a6ce8-34df-458a-8e10-b5e4a22f68f1 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:11.890730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a6ce8-34df-458a-8e10-b5e4a22f68f1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:11.890730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a6ce8-34df-458a-8e10-b5e4a22f68f1 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:11.892046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:38:11.896973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67f431-e837-471e-826e-6fba6d6028cf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:11.897369 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67f431-e837-471e-826e-6fba6d6028cf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:11.897606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67f431-e837-471e-826e-6fba6d6028cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:11.917600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7d67f431-e837-471e-826e-6fba6d6028cf None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:11.918803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7d67f431-e837-471e-826e-6fba6d6028cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:11.927005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:38:12.085651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a6ce8-34df-458a-8e10-b5e4a22f68f1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:38:12.100853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a6ce8-34df-458a-8e10-b5e4a22f68f1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:38:12.107104 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b0c6c-2404-466b-8677-575f8b7b63c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:38:12.107708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b0c6c-2404-466b-8677-575f8b7b63c7 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:12.107990 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b0c6c-2404-466b-8677-575f8b7b63c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:12.108295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b0c6c-2404-466b-8677-575f8b7b63c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:12.116344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b0c6c-2404-466b-8677-575f8b7b63c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:38:12.117921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b0c6c-2404-466b-8677-575f8b7b63c7 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:38:12.127395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 770/1527] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:38:16.224472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d11737-3f8d-458e-8cdd-09ec3103df06 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:16.224995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d11737-3f8d-458e-8cdd-09ec3103df06 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:16.224995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d11737-3f8d-458e-8cdd-09ec3103df06 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:16.226300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:38:16.231885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f095200-8ab3-467b-a93f-ee4af0f7520f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:16.232299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f095200-8ab3-467b-a93f-ee4af0f7520f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:16.232469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f095200-8ab3-467b-a93f-ee4af0f7520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:16.252294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2f095200-8ab3-467b-a93f-ee4af0f7520f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:16.253495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2f095200-8ab3-467b-a93f-ee4af0f7520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:16.261397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:38:16.332973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d11737-3f8d-458e-8cdd-09ec3103df06 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:38:16.334683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e8d11737-3f8d-458e-8cdd-09ec3103df06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:16.418147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d11737-3f8d-458e-8cdd-09ec3103df06 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:38:16.421658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a21e8-eec4-4601-a378-dec62e58d3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:38:16.422268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a21e8-eec4-4601-a378-dec62e58d3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:16.422554 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a21e8-eec4-4601-a378-dec62e58d3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:16.422826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a21e8-eec4-4601-a378-dec62e58d3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:16.431752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a21e8-eec4-4601-a378-dec62e58d3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:38:16.433239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a21e8-eec4-4601-a378-dec62e58d3b0 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:38:16.442440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 759/1530] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:38:18.438588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea2aea-9471-4656-9648-53c11831b616 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:18.439173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea2aea-9471-4656-9648-53c11831b616 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:18.439278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea2aea-9471-4656-9648-53c11831b616 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:18.440686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:38:18.445889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff38f3d-2df8-4793-816f-2562bade6efb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:18.446315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff38f3d-2df8-4793-816f-2562bade6efb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:18.446423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff38f3d-2df8-4793-816f-2562bade6efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:18.466557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0ff38f3d-2df8-4793-816f-2562bade6efb None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:18.467748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0ff38f3d-2df8-4793-816f-2562bade6efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:18.475461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:38:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:38:18.511766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea2aea-9471-4656-9648-53c11831b616 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:38:18.522321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea2aea-9471-4656-9648-53c11831b616 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:38:18.526391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaa4f5-5f0f-41a1-b547-1b036d4b846a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:38:18.527012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa4f5-5f0f-41a1-b547-1b036d4b846a service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:18.527323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa4f5-5f0f-41a1-b547-1b036d4b846a service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:18.527617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa4f5-5f0f-41a1-b547-1b036d4b846a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:18.537336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaa4f5-5f0f-41a1-b547-1b036d4b846a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:38:18.538770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaa4f5-5f0f-41a1-b547-1b036d4b846a service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:38:18.549245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 773/1533] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:38:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:38:22.139014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9a5b-3ebe-4b26-9eba-5b10f8cfa381 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:22.139541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9a5b-3ebe-4b26-9eba-5b10f8cfa381 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:22.139541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc9a5b-3ebe-4b26-9eba-5b10f8cfa381 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:22.140865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:38:22.146002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f63a7f-2fd6-47b4-81b5-7f8167be7b28 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:22.146405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f63a7f-2fd6-47b4-81b5-7f8167be7b28 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:22.146545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f63a7f-2fd6-47b4-81b5-7f8167be7b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:22.154471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=81 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:38:22.167538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b0f63a7f-2fd6-47b4-81b5-7f8167be7b28 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:22.168841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b0f63a7f-2fd6-47b4-81b5-7f8167be7b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:22.176619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:38:22.490533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc9a5b-3ebe-4b26-9eba-5b10f8cfa381 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:38:22.492317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-92cc9a5b-3ebe-4b26-9eba-5b10f8cfa381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:22.558804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:38:22.572432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc9a5b-3ebe-4b26-9eba-5b10f8cfa381 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:38:22.576004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b5ae1-eb4f-4316-b876-728ddaef8ef4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:38:22.576714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5ae1-eb4f-4316-b876-728ddaef8ef4 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:22.577004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5ae1-eb4f-4316-b876-728ddaef8ef4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:22.577294 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5ae1-eb4f-4316-b876-728ddaef8ef4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:22.586411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b5ae1-eb4f-4316-b876-728ddaef8ef4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:38:22.588414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b5ae1-eb4f-4316-b876-728ddaef8ef4 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:38:22.597906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 762/1536] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:38:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:38:24.662998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a4d15-867e-4c46-8550-ff118be23921 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:24.663550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a4d15-867e-4c46-8550-ff118be23921 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:24.663550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a4d15-867e-4c46-8550-ff118be23921 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:24.665554 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:38:24.670610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c764f-fd0b-4bc0-8817-05dd353963ce None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:24.670990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c764f-fd0b-4bc0-8817-05dd353963ce None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:24.671163 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c764f-fd0b-4bc0-8817-05dd353963ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:24.690228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-470c764f-fd0b-4bc0-8817-05dd353963ce None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:24.691428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-470c764f-fd0b-4bc0-8817-05dd353963ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:24.699429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:38:25.000818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a4d15-867e-4c46-8550-ff118be23921 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:38:25.002499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d56a4d15-867e-4c46-8550-ff118be23921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:25.015827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a4d15-867e-4c46-8550-ff118be23921 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:38:25.019419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d87ef9-6324-4605-b73b-a00f170042e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:38:25.020015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d87ef9-6324-4605-b73b-a00f170042e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:25.020326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d87ef9-6324-4605-b73b-a00f170042e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:25.020596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d87ef9-6324-4605-b73b-a00f170042e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:25.030532 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d87ef9-6324-4605-b73b-a00f170042e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:38:25.031971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d87ef9-6324-4605-b73b-a00f170042e0 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:38:25.041164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 776/1539] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:38:34.685513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=11 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:38:35.037021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=8 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:55.044704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6625319-c8a0-4bac-bd5f-eec5589e5f96 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.045847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6625319-c8a0-4bac-bd5f-eec5589e5f96 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.046360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6625319-c8a0-4bac-bd5f-eec5589e5f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.070626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d6625319-c8a0-4bac-bd5f-eec5589e5f96 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.072448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d6625319-c8a0-4bac-bd5f-eec5589e5f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.085947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 764/1540] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.094935 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feac7f-3793-4598-8223-d3381c3edfda None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.095484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feac7f-3793-4598-8223-d3381c3edfda None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.095484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3feac7f-3793-4598-8223-d3381c3edfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.128294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c3feac7f-3793-4598-8223-d3381c3edfda None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.130256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c3feac7f-3793-4598-8223-d3381c3edfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.144973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 777/1541] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.149968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6625319-c8a0-4bac-bd5f-eec5589e5f96 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.165972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6625319-c8a0-4bac-bd5f-eec5589e5f96 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.176086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d55fe3-bdfd-42c8-886d-fb158ad0814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.176747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55fe3-bdfd-42c8-886d-fb158ad0814a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.177029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55fe3-bdfd-42c8-886d-fb158ad0814a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.177304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d55fe3-bdfd-42c8-886d-fb158ad0814a admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.178010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d55fe3-bdfd-42c8-886d-fb158ad0814a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:39:55.178316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d55fe3-bdfd-42c8-886d-fb158ad0814a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.179915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d55fe3-bdfd-42c8-886d-fb158ad0814a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.199870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 765/1542] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:39:55.208217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feac7f-3793-4598-8223-d3381c3edfda None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.220005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684741b7-3adf-4e82-9ea1-cfa2da43f87b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.220345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684741b7-3adf-4e82-9ea1-cfa2da43f87b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.220601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684741b7-3adf-4e82-9ea1-cfa2da43f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.223228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3feac7f-3793-4598-8223-d3381c3edfda None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.232722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c630ca-9632-4825-82e1-148121a4b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.233692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c630ca-9632-4825-82e1-148121a4b355 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.234201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c630ca-9632-4825-82e1-148121a4b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.234687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c630ca-9632-4825-82e1-148121a4b355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.235571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c630ca-9632-4825-82e1-148121a4b355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.237899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c630ca-9632-4825-82e1-148121a4b355 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.249489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-684741b7-3adf-4e82-9ea1-cfa2da43f87b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.251072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-684741b7-3adf-4e82-9ea1-cfa2da43f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.268425 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 766/1543] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.270035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b42a3-6e22-4a34-ba07-249c721c788e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.270555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b42a3-6e22-4a34-ba07-249c721c788e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.271043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b42a3-6e22-4a34-ba07-249c721c788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.303995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f31b42a3-6e22-4a34-ba07-249c721c788e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.306188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f31b42a3-6e22-4a34-ba07-249c721c788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.314724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 778/1544] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:55.316038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 767/1545] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.316461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a9d25-c738-4dfb-bee9-399cde321f9a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.316759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a9d25-c738-4dfb-bee9-399cde321f9a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.317040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a9d25-c738-4dfb-bee9-399cde321f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.318288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc39379-1171-4dc9-92b0-6c421733f07f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.318736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc39379-1171-4dc9-92b0-6c421733f07f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.319174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc39379-1171-4dc9-92b0-6c421733f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.345621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8bc39379-1171-4dc9-92b0-6c421733f07f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.346402 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-df1a9d25-c738-4dfb-bee9-399cde321f9a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.347596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8bc39379-1171-4dc9-92b0-6c421733f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.347714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-df1a9d25-c738-4dfb-bee9-399cde321f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.408642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 779/1546] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.409890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b2da7-035a-4ebd-9b53-8901f1ce870a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.410181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b2da7-035a-4ebd-9b53-8901f1ce870a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.410455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b2da7-035a-4ebd-9b53-8901f1ce870a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.417408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 768/1547] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.418741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229b43-9dfe-4bcf-b0de-1a15a805bc41 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.419031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229b43-9dfe-4bcf-b0de-1a15a805bc41 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.419305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229b43-9dfe-4bcf-b0de-1a15a805bc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.431175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-974b2da7-035a-4ebd-9b53-8901f1ce870a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.432416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-974b2da7-035a-4ebd-9b53-8901f1ce870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.438982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3e229b43-9dfe-4bcf-b0de-1a15a805bc41 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.440171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3e229b43-9dfe-4bcf-b0de-1a15a805bc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.440295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 780/1548] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.441037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b2da7-035a-4ebd-9b53-8901f1ce870a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.449568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 769/1549] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.450483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b2da7-035a-4ebd-9b53-8901f1ce870a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.450892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9045-5878-4d8b-8907-21e357e0a3c4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.451181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9045-5878-4d8b-8907-21e357e0a3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.451456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9045-5878-4d8b-8907-21e357e0a3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.455698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fb86f9-0ee2-4b4c-addd-52d8e9b596d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.456341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb86f9-0ee2-4b4c-addd-52d8e9b596d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.456627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb86f9-0ee2-4b4c-addd-52d8e9b596d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.457140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fb86f9-0ee2-4b4c-addd-52d8e9b596d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.457811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb86f9-0ee2-4b4c-addd-52d8e9b596d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.458842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: WARNING py.warnings [None req-a1fb86f9-0ee2-4b4c-addd-52d8e9b596d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:39:55.458842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: warnings.warn(msg) Aug 02 21:39:55.458842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: Aug 02 21:39:55.460039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fb86f9-0ee2-4b4c-addd-52d8e9b596d5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.471397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2c6c9045-5878-4d8b-8907-21e357e0a3c4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.472624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2c6c9045-5878-4d8b-8907-21e357e0a3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.481189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 770/1550] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.482338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917c12-68b5-4b1c-9a59-3c9902dedeb2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.482680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 781/1551] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/users => generated 283 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:55.482816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917c12-68b5-4b1c-9a59-3c9902dedeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.482954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23917c12-68b5-4b1c-9a59-3c9902dedeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.484126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e040-598e-48a5-9c18-26b7c175d9dc None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.484516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e040-598e-48a5-9c18-26b7c175d9dc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.484968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7e040-598e-48a5-9c18-26b7c175d9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.503172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-23917c12-68b5-4b1c-9a59-3c9902dedeb2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.504394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-23917c12-68b5-4b1c-9a59-3c9902dedeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.504527 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-35f7e040-598e-48a5-9c18-26b7c175d9dc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.505644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-35f7e040-598e-48a5-9c18-26b7c175d9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.512847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 771/1552] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.520557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74fcff-e47d-4a07-970b-5cb59a930f8f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.520763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 782/1553] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.520862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74fcff-e47d-4a07-970b-5cb59a930f8f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.520862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74fcff-e47d-4a07-970b-5cb59a930f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.521056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57376882-984a-485d-bdc9-21318e9a6450 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.521056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57376882-984a-485d-bdc9-21318e9a6450 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.521056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57376882-984a-485d-bdc9-21318e9a6450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.537772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-57376882-984a-485d-bdc9-21318e9a6450 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.539000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-57376882-984a-485d-bdc9-21318e9a6450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.539514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7b74fcff-e47d-4a07-970b-5cb59a930f8f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.541236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b74fcff-e47d-4a07-970b-5cb59a930f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.547458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 783/1554] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.548257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57376882-984a-485d-bdc9-21318e9a6450 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.549076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 772/1555] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.552734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f083e5d-4c82-47b6-bd89-aeffe97e4049 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.552734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f083e5d-4c82-47b6-bd89-aeffe97e4049 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.552734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f083e5d-4c82-47b6-bd89-aeffe97e4049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.558888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57376882-984a-485d-bdc9-21318e9a6450 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.563427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.564033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.564349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.564637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.565335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:39:55.565612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.566621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: WARNING py.warnings [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:39:55.566621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: warnings.warn(msg) Aug 02 21:39:55.566621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: Aug 02 21:39:55.567495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.572082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2f083e5d-4c82-47b6-bd89-aeffe97e4049 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.573307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2f083e5d-4c82-47b6-bd89-aeffe97e4049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.579304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 784/1556] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:39:55.580174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.581346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 773/1557] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.581975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f083e5d-4c82-47b6-bd89-aeffe97e4049 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.589871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05494c-e480-4afd-aa7e-500e71e69d60 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.592344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f083e5d-4c82-47b6-bd89-aeffe97e4049 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.594442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e99f6-ff0b-49de-8e91-369f41faef6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.595074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e99f6-ff0b-49de-8e91-369f41faef6f admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.595352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e99f6-ff0b-49de-8e91-369f41faef6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.595680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e99f6-ff0b-49de-8e91-369f41faef6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.596351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e99f6-ff0b-49de-8e91-369f41faef6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.597101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8fafe-c295-4505-8f15-60b9da65d183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.597704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8fafe-c295-4505-8f15-60b9da65d183 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.597950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e99f6-ff0b-49de-8e91-369f41faef6f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.598060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8fafe-c295-4505-8f15-60b9da65d183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.598248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8fafe-c295-4505-8f15-60b9da65d183 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.598943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8fafe-c295-4505-8f15-60b9da65d183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:39:55.599247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8fafe-c295-4505-8f15-60b9da65d183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.600857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8fafe-c295-4505-8f15-60b9da65d183 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.608720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 785/1558] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:55.610026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13063cd0-c5ab-4949-ab48-e1bd817d7803 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.610314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13063cd0-c5ab-4949-ab48-e1bd817d7803 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.610586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13063cd0-c5ab-4949-ab48-e1bd817d7803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.613607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 774/1559] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:39:55.614997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a49f06-56b7-474c-961a-825c868b9f41 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.615290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a49f06-56b7-474c-961a-825c868b9f41 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.615562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a49f06-56b7-474c-961a-825c868b9f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.632660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-13063cd0-c5ab-4949-ab48-e1bd817d7803 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.634385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-13063cd0-c5ab-4949-ab48-e1bd817d7803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.634625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e4a49f06-56b7-474c-961a-825c868b9f41 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:55.635792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e4a49f06-56b7-474c-961a-825c868b9f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:55.642162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 786/1560] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.642919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13063cd0-c5ab-4949-ab48-e1bd817d7803 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.643844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 775/1561] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:55.647958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a49f06-56b7-474c-961a-825c868b9f41 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.652227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13063cd0-c5ab-4949-ab48-e1bd817d7803 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.657056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a544319-61ed-4753-b68f-f1a6777db763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.657648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a544319-61ed-4753-b68f-f1a6777db763 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.657770 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a49f06-56b7-474c-961a-825c868b9f41 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.657930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a544319-61ed-4753-b68f-f1a6777db763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.658206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a544319-61ed-4753-b68f-f1a6777db763 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.658893 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a544319-61ed-4753-b68f-f1a6777db763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:39:55.659194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a544319-61ed-4753-b68f-f1a6777db763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.661230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a544319-61ed-4753-b68f-f1a6777db763 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.662253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fedc06-d30b-4c56-9dd0-9ad7110ce620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.663022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fedc06-d30b-4c56-9dd0-9ad7110ce620 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.663306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fedc06-d30b-4c56-9dd0-9ad7110ce620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.664035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fedc06-d30b-4c56-9dd0-9ad7110ce620 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.664759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fedc06-d30b-4c56-9dd0-9ad7110ce620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:39:55.665577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fedc06-d30b-4c56-9dd0-9ad7110ce620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.667138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fedc06-d30b-4c56-9dd0-9ad7110ce620 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.673894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 787/1562] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:39:55.674593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a544319-61ed-4753-b68f-f1a6777db763 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.679407 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 776/1563] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:39:55.680088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fedc06-d30b-4c56-9dd0-9ad7110ce620 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.688272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a544319-61ed-4753-b68f-f1a6777db763 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.691111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fedc06-d30b-4c56-9dd0-9ad7110ce620 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.692952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977dbfb-99ff-449b-bd9d-4f6c33b2f18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.693555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977dbfb-99ff-449b-bd9d-4f6c33b2f18b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.693838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977dbfb-99ff-449b-bd9d-4f6c33b2f18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.694118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7977dbfb-99ff-449b-bd9d-4f6c33b2f18b admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.694803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977dbfb-99ff-449b-bd9d-4f6c33b2f18b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.695779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bfaa8-8a0b-426f-859e-d38537a46e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.697131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bfaa8-8a0b-426f-859e-d38537a46e2e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.697411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bfaa8-8a0b-426f-859e-d38537a46e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.697515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7977dbfb-99ff-449b-bd9d-4f6c33b2f18b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.697680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bfaa8-8a0b-426f-859e-d38537a46e2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.698358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bfaa8-8a0b-426f-859e-d38537a46e2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:39:55.698659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bfaa8-8a0b-426f-859e-d38537a46e2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.700244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bfaa8-8a0b-426f-859e-d38537a46e2e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.712645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 777/1564] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:39:55.713470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bfaa8-8a0b-426f-859e-d38537a46e2e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.727204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 788/1565] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:55.728807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977dbfb-99ff-449b-bd9d-4f6c33b2f18b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.730790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bfaa8-8a0b-426f-859e-d38537a46e2e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.749119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:55.775745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:55.788939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7466fa2-b0da-4a2f-87b8-e26991c662f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.789629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7466fa2-b0da-4a2f-87b8-e26991c662f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.790436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7466fa2-b0da-4a2f-87b8-e26991c662f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.790708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7466fa2-b0da-4a2f-87b8-e26991c662f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.791399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7466fa2-b0da-4a2f-87b8-e26991c662f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.793026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7466fa2-b0da-4a2f-87b8-e26991c662f3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.793305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7977dbfb-99ff-449b-bd9d-4f6c33b2f18b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.798416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36352e3-577b-4a68-92f8-bd876ace8f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.798971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36352e3-577b-4a68-92f8-bd876ace8f1e admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.799257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36352e3-577b-4a68-92f8-bd876ace8f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.799525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36352e3-577b-4a68-92f8-bd876ace8f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.800292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36352e3-577b-4a68-92f8-bd876ace8f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.802208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36352e3-577b-4a68-92f8-bd876ace8f1e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.804201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 778/1566] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:55.804201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7466fa2-b0da-4a2f-87b8-e26991c662f3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.814483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7466fa2-b0da-4a2f-87b8-e26991c662f3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.819461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720b120-bd28-4dac-bd09-74c3ee87ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.820077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720b120-bd28-4dac-bd09-74c3ee87ccef admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.820447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720b120-bd28-4dac-bd09-74c3ee87ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.820719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720b120-bd28-4dac-bd09-74c3ee87ccef admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.821890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720b120-bd28-4dac-bd09-74c3ee87ccef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:39:55.822337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720b120-bd28-4dac-bd09-74c3ee87ccef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.824071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720b120-bd28-4dac-bd09-74c3ee87ccef admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.831339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 789/1567] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:55.832189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36352e3-577b-4a68-92f8-bd876ace8f1e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.837763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 779/1568] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:39:55.838725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720b120-bd28-4dac-bd09-74c3ee87ccef admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.848468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720b120-bd28-4dac-bd09-74c3ee87ccef admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.897573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36352e3-577b-4a68-92f8-bd876ace8f1e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.903036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac07ac-7fe7-4c3c-a3cc-951aa425ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.903652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac07ac-7fe7-4c3c-a3cc-951aa425ed3c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.903930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac07ac-7fe7-4c3c-a3cc-951aa425ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.904223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac07ac-7fe7-4c3c-a3cc-951aa425ed3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.904912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac07ac-7fe7-4c3c-a3cc-951aa425ed3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:39:55.905209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac07ac-7fe7-4c3c-a3cc-951aa425ed3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.905412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223821c1-d655-4114-8cf9-0b5d8e73a7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.906026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223821c1-d655-4114-8cf9-0b5d8e73a7e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.906308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223821c1-d655-4114-8cf9-0b5d8e73a7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.906580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223821c1-d655-4114-8cf9-0b5d8e73a7e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.906792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac07ac-7fe7-4c3c-a3cc-951aa425ed3c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.907266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223821c1-d655-4114-8cf9-0b5d8e73a7e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.908295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING py.warnings [None req-223821c1-d655-4114-8cf9-0b5d8e73a7e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:39:55.908295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: warnings.warn(msg) Aug 02 21:39:55.908295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: Aug 02 21:39:55.909515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223821c1-d655-4114-8cf9-0b5d8e73a7e4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.917884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 790/1569] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:39:55.918731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac07ac-7fe7-4c3c-a3cc-951aa425ed3c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.927801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac07ac-7fe7-4c3c-a3cc-951aa425ed3c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:55.932874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de0bf7-2ffc-4a86-ac5c-32a6bb06ba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:55.933472 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de0bf7-2ffc-4a86-ac5c-32a6bb06ba0d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:55.933748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de0bf7-2ffc-4a86-ac5c-32a6bb06ba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:55.934015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de0bf7-2ffc-4a86-ac5c-32a6bb06ba0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:55.934660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de0bf7-2ffc-4a86-ac5c-32a6bb06ba0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:55.936832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de0bf7-2ffc-4a86-ac5c-32a6bb06ba0d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:55.948208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 780/1570] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:55.948208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223821c1-d655-4114-8cf9-0b5d8e73a7e4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:55.971223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 791/1571] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:55.971223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de0bf7-2ffc-4a86-ac5c-32a6bb06ba0d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.014816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223821c1-d655-4114-8cf9-0b5d8e73a7e4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.029639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de0bf7-2ffc-4a86-ac5c-32a6bb06ba0d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.034955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9fbfe-1838-46ea-a974-c6ac66c9d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.035636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9fbfe-1838-46ea-a974-c6ac66c9d9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.035834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9fbfe-1838-46ea-a974-c6ac66c9d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.036117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9fbfe-1838-46ea-a974-c6ac66c9d9ea admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.036771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9fbfe-1838-46ea-a974-c6ac66c9d9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.038675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9fbfe-1838-46ea-a974-c6ac66c9d9ea admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.063191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 792/1572] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.063191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9fbfe-1838-46ea-a974-c6ac66c9d9ea admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.070409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9fbfe-1838-46ea-a974-c6ac66c9d9ea admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.075255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5eb4-4c34-47dd-a903-fa4590b356a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.075992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5eb4-4c34-47dd-a903-fa4590b356a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.076426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5eb4-4c34-47dd-a903-fa4590b356a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.076702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5eb4-4c34-47dd-a903-fa4590b356a6 admin admin] PATH_INFO: `/v3/projects/06586f2fd2b54a30b14582919e042b90/users/ec12182bfb3a43658b27aa984e3bffc6/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.076894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b2dc4-1aa8-40a1-9516-7dd8a1d95723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.077453 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b2dc4-1aa8-40a1-9516-7dd8a1d95723 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.077739 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b2dc4-1aa8-40a1-9516-7dd8a1d95723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.078063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493b2dc4-1aa8-40a1-9516-7dd8a1d95723 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.078734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b2dc4-1aa8-40a1-9516-7dd8a1d95723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.079140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:56.080700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493b2dc4-1aa8-40a1-9516-7dd8a1d95723 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.091060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:56.094693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5eb4-4c34-47dd-a903-fa4590b356a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06586f2fd2b54a30b14582919e042b90, user_id=ec12182bfb3a43658b27aa984e3bffc6, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.097384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5eb4-4c34-47dd-a903-fa4590b356a6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.111117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 793/1573] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:56 2022] PUT /identity/v3/projects/06586f2fd2b54a30b14582919e042b90/users/ec12182bfb3a43658b27aa984e3bffc6/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:56.111907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 781/1574] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:55 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.112122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5eb4-4c34-47dd-a903-fa4590b356a6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.112771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b2dc4-1aa8-40a1-9516-7dd8a1d95723 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.177669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493b2dc4-1aa8-40a1-9516-7dd8a1d95723 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.182836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110368aa-6ab2-4903-b9db-07d80c1d77e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.183453 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110368aa-6ab2-4903-b9db-07d80c1d77e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.183736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110368aa-6ab2-4903-b9db-07d80c1d77e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.184009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110368aa-6ab2-4903-b9db-07d80c1d77e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.184714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110368aa-6ab2-4903-b9db-07d80c1d77e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.185272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5eb4-4c34-47dd-a903-fa4590b356a6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.186624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110368aa-6ab2-4903-b9db-07d80c1d77e3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.189967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6e331-d34c-420d-8e05-d4f651dba101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.190607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6e331-d34c-420d-8e05-d4f651dba101 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.190886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6e331-d34c-420d-8e05-d4f651dba101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.191156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db6e331-d34c-420d-8e05-d4f651dba101 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.191807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6e331-d34c-420d-8e05-d4f651dba101 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.194125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db6e331-d34c-420d-8e05-d4f651dba101 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.218192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 782/1575] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:56 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.218414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 794/1576] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:56 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.218509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110368aa-6ab2-4903-b9db-07d80c1d77e3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.218608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6e331-d34c-420d-8e05-d4f651dba101 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.229516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db6e331-d34c-420d-8e05-d4f651dba101 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.281368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110368aa-6ab2-4903-b9db-07d80c1d77e3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.286005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe5164-5918-4143-893d-05802cb8f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.286614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe5164-5918-4143-893d-05802cb8f57e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.286744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b284e1-363d-4d84-a1ee-b9ceb84d480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.286895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe5164-5918-4143-893d-05802cb8f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.287168 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe5164-5918-4143-893d-05802cb8f57e admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.287282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b284e1-363d-4d84-a1ee-b9ceb84d480b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.287622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b284e1-363d-4d84-a1ee-b9ceb84d480b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.287856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe5164-5918-4143-893d-05802cb8f57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.287961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b284e1-363d-4d84-a1ee-b9ceb84d480b admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.288572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b284e1-363d-4d84-a1ee-b9ceb84d480b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.290323 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fe5164-5918-4143-893d-05802cb8f57e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.291123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b284e1-363d-4d84-a1ee-b9ceb84d480b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.314112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 795/1577] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:56 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.315047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b284e1-363d-4d84-a1ee-b9ceb84d480b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.320414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 783/1578] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:56 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.320414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe5164-5918-4143-893d-05802cb8f57e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.326503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b284e1-363d-4d84-a1ee-b9ceb84d480b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.382535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe5164-5918-4143-893d-05802cb8f57e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.382766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56a065-dbcf-49c6-9353-6db10108d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.383116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56a065-dbcf-49c6-9353-6db10108d704 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.383393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56a065-dbcf-49c6-9353-6db10108d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.383700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa56a065-dbcf-49c6-9353-6db10108d704 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.384387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56a065-dbcf-49c6-9353-6db10108d704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.386299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa56a065-dbcf-49c6-9353-6db10108d704 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.387065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb4ca3-101f-488e-88bc-558d417bc18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.387675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb4ca3-101f-488e-88bc-558d417bc18c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.387958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb4ca3-101f-488e-88bc-558d417bc18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.388266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb4ca3-101f-488e-88bc-558d417bc18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.388965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb4ca3-101f-488e-88bc-558d417bc18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.390547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb4ca3-101f-488e-88bc-558d417bc18c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.391802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:56.395073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:56.401978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 784/1579] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.406736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0ffd5-7351-4c0b-87c9-cc775750fc5d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.407210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0ffd5-7351-4c0b-87c9-cc775750fc5d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.407708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb0ffd5-7351-4c0b-87c9-cc775750fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.411871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 796/1580] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:56 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.411871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56a065-dbcf-49c6-9353-6db10108d704 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.419456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa56a065-dbcf-49c6-9353-6db10108d704 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.424175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef848622-4237-4c27-bbcb-c884595cea57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.424792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef848622-4237-4c27-bbcb-c884595cea57 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.425098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef848622-4237-4c27-bbcb-c884595cea57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.425312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef848622-4237-4c27-bbcb-c884595cea57 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.425962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef848622-4237-4c27-bbcb-c884595cea57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.427898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef848622-4237-4c27-bbcb-c884595cea57 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.435712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3fb0ffd5-7351-4c0b-87c9-cc775750fc5d None None] MFA Rules not processed for user `ec12182bfb3a43658b27aa984e3bffc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:56.436962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3fb0ffd5-7351-4c0b-87c9-cc775750fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:56.452521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 797/1581] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:56 2022] POST /identity/v3/users => generated 290 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.452521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef848622-4237-4c27-bbcb-c884595cea57 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.461656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef848622-4237-4c27-bbcb-c884595cea57 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.466842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26e4b2-4177-49f5-a31f-12917f02865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.467432 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26e4b2-4177-49f5-a31f-12917f02865f admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.467721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26e4b2-4177-49f5-a31f-12917f02865f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.467990 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c26e4b2-4177-49f5-a31f-12917f02865f admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.468670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26e4b2-4177-49f5-a31f-12917f02865f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.470551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c26e4b2-4177-49f5-a31f-12917f02865f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.492805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 798/1582] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:56 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.494305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26e4b2-4177-49f5-a31f-12917f02865f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.503835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c26e4b2-4177-49f5-a31f-12917f02865f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.505650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 785/1583] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:56.506603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0ffd5-7351-4c0b-87c9-cc775750fc5d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.508475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7ee9f-bd8c-4f36-8e9e-0a36cef163fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.509146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7ee9f-bd8c-4f36-8e9e-0a36cef163fb admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.509388 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7ee9f-bd8c-4f36-8e9e-0a36cef163fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.509661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7ee9f-bd8c-4f36-8e9e-0a36cef163fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.510364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7ee9f-bd8c-4f36-8e9e-0a36cef163fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.511953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7ee9f-bd8c-4f36-8e9e-0a36cef163fb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.519801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb0ffd5-7351-4c0b-87c9-cc775750fc5d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.525746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 799/1584] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.525746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7ee9f-bd8c-4f36-8e9e-0a36cef163fb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.528103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ca40b-5946-4ea3-b126-bdc10a3ba4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.528745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ca40b-5946-4ea3-b126-bdc10a3ba4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.529023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ca40b-5946-4ea3-b126-bdc10a3ba4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.529291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ca40b-5946-4ea3-b126-bdc10a3ba4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.529980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ca40b-5946-4ea3-b126-bdc10a3ba4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.531552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8ca40b-5946-4ea3-b126-bdc10a3ba4a5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.535578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7ee9f-bd8c-4f36-8e9e-0a36cef163fb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.540798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0384d7-42e1-462f-83f9-ba90778cfd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.541389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0384d7-42e1-462f-83f9-ba90778cfd4f admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.541672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0384d7-42e1-462f-83f9-ba90778cfd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.541946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0384d7-42e1-462f-83f9-ba90778cfd4f admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.542596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0384d7-42e1-462f-83f9-ba90778cfd4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.544179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 786/1585] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.544179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ca40b-5946-4ea3-b126-bdc10a3ba4a5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.544727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0384d7-42e1-462f-83f9-ba90778cfd4f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.554258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ca40b-5946-4ea3-b126-bdc10a3ba4a5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.561204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e689a-b835-4bd1-887b-260c188ea477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.561825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e689a-b835-4bd1-887b-260c188ea477 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.562193 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e689a-b835-4bd1-887b-260c188ea477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.562387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e689a-b835-4bd1-887b-260c188ea477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.563410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e689a-b835-4bd1-887b-260c188ea477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.564912 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e689a-b835-4bd1-887b-260c188ea477 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.578856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 800/1586] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:56 2022] POST /identity/v3/users => generated 294 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:56.579059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 787/1587] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.583090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e689a-b835-4bd1-887b-260c188ea477 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.583235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0384d7-42e1-462f-83f9-ba90778cfd4f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.592721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e689a-b835-4bd1-887b-260c188ea477 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.592888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0384d7-42e1-462f-83f9-ba90778cfd4f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.597164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960a771-8a5a-42da-bd4a-53767faf24bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.597385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ca9e0-7858-43b5-be88-a1cda6cae6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.597758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960a771-8a5a-42da-bd4a-53767faf24bd admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.597986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ca9e0-7858-43b5-be88-a1cda6cae6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.598101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960a771-8a5a-42da-bd4a-53767faf24bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.598267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ca9e0-7858-43b5-be88-a1cda6cae6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.598386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960a771-8a5a-42da-bd4a-53767faf24bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.598541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ca9e0-7858-43b5-be88-a1cda6cae6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.598956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960a771-8a5a-42da-bd4a-53767faf24bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.599230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ca9e0-7858-43b5-be88-a1cda6cae6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.600564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960a771-8a5a-42da-bd4a-53767faf24bd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.600858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ca9e0-7858-43b5-be88-a1cda6cae6d2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.611628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 801/1588] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.614865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 788/1589] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.614973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ca9e0-7858-43b5-be88-a1cda6cae6d2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.615086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960a771-8a5a-42da-bd4a-53767faf24bd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.624540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ca9e0-7858-43b5-be88-a1cda6cae6d2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.629510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aff282-0938-4749-ad12-54b3a5f3a382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.630112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aff282-0938-4749-ad12-54b3a5f3a382 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.630647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aff282-0938-4749-ad12-54b3a5f3a382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.630647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aff282-0938-4749-ad12-54b3a5f3a382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.631344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aff282-0938-4749-ad12-54b3a5f3a382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.634671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aff282-0938-4749-ad12-54b3a5f3a382 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.644400 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 802/1590] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.645183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aff282-0938-4749-ad12-54b3a5f3a382 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.655344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aff282-0938-4749-ad12-54b3a5f3a382 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.659966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faf0ec-b604-4cc4-8dce-990449387c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.660580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf0ec-b604-4cc4-8dce-990449387c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.660872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf0ec-b604-4cc4-8dce-990449387c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.661149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2faf0ec-b604-4cc4-8dce-990449387c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.661824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2faf0ec-b604-4cc4-8dce-990449387c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.663381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2faf0ec-b604-4cc4-8dce-990449387c55 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.668920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960a771-8a5a-42da-bd4a-53767faf24bd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.672502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf464d8-d894-45b5-93b4-404b746253c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.673105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf464d8-d894-45b5-93b4-404b746253c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.673382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf464d8-d894-45b5-93b4-404b746253c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.673653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf464d8-d894-45b5-93b4-404b746253c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.673756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 803/1591] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.674464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faf0ec-b604-4cc4-8dce-990449387c55 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.684701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf464d8-d894-45b5-93b4-404b746253c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.685847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2faf0ec-b604-4cc4-8dce-990449387c55 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.686106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf464d8-d894-45b5-93b4-404b746253c2 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.690418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb83b-3c40-4e99-9f00-8e8802449d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.690991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb83b-3c40-4e99-9f00-8e8802449d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.691277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb83b-3c40-4e99-9f00-8e8802449d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.691554 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addb83b-3c40-4e99-9f00-8e8802449d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.692270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addb83b-3c40-4e99-9f00-8e8802449d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.693801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addb83b-3c40-4e99-9f00-8e8802449d6c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.694683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 789/1592] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:56.695617 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf464d8-d894-45b5-93b4-404b746253c2 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.707742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 804/1593] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.707742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb83b-3c40-4e99-9f00-8e8802449d6c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.710265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf464d8-d894-45b5-93b4-404b746253c2 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.715875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540078a1-bebb-4a70-9fc4-0dc6720adb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.716494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540078a1-bebb-4a70-9fc4-0dc6720adb3f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.716774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540078a1-bebb-4a70-9fc4-0dc6720adb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.717046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540078a1-bebb-4a70-9fc4-0dc6720adb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.717728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540078a1-bebb-4a70-9fc4-0dc6720adb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.719401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540078a1-bebb-4a70-9fc4-0dc6720adb3f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.719807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addb83b-3c40-4e99-9f00-8e8802449d6c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.725613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e5b05-714f-4dc4-9021-13181780510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.726445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e5b05-714f-4dc4-9021-13181780510b admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.726739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e5b05-714f-4dc4-9021-13181780510b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.727018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e5b05-714f-4dc4-9021-13181780510b admin admin] PATH_INFO: `/v3/projects/c63bab062a6e4225a462ac0265535d16/users/e477f5953a534355b29c071086846ff6/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.730224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 790/1594] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.731056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540078a1-bebb-4a70-9fc4-0dc6720adb3f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.740252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540078a1-bebb-4a70-9fc4-0dc6720adb3f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.745517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e5b05-714f-4dc4-9021-13181780510b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63bab062a6e4225a462ac0265535d16, user_id=e477f5953a534355b29c071086846ff6, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.745795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ef94d-6d05-4ada-85e6-87dcf052d1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.746476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ef94d-6d05-4ada-85e6-87dcf052d1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.746826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ef94d-6d05-4ada-85e6-87dcf052d1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.747168 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ef94d-6d05-4ada-85e6-87dcf052d1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.747929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ef94d-6d05-4ada-85e6-87dcf052d1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.748190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e5b05-714f-4dc4-9021-13181780510b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.749737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ef94d-6d05-4ada-85e6-87dcf052d1bb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.763853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 791/1595] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.763853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ef94d-6d05-4ada-85e6-87dcf052d1bb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.770193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 805/1596] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:56 2022] PUT /identity/v3/projects/c63bab062a6e4225a462ac0265535d16/users/e477f5953a534355b29c071086846ff6/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:56.770193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e5b05-714f-4dc4-9021-13181780510b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.776014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ef94d-6d05-4ada-85e6-87dcf052d1bb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.817086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:56.840968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e5b05-714f-4dc4-9021-13181780510b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.845937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c7d3-14d3-41a8-9009-57fe08fd7e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.846079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe061fc-a763-425d-823d-c7aab3541296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.846822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe061fc-a763-425d-823d-c7aab3541296 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.847105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe061fc-a763-425d-823d-c7aab3541296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.847322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c7d3-14d3-41a8-9009-57fe08fd7e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.847438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe061fc-a763-425d-823d-c7aab3541296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.847899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c7d3-14d3-41a8-9009-57fe08fd7e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.848057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe061fc-a763-425d-823d-c7aab3541296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.848559 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9c7d3-14d3-41a8-9009-57fe08fd7e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.849575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9c7d3-14d3-41a8-9009-57fe08fd7e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.849697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe061fc-a763-425d-823d-c7aab3541296 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.851913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9c7d3-14d3-41a8-9009-57fe08fd7e95 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.861040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 792/1597] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.861848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe061fc-a763-425d-823d-c7aab3541296 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.863263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 806/1598] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:56.864080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c7d3-14d3-41a8-9009-57fe08fd7e95 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.871831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe061fc-a763-425d-823d-c7aab3541296 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.876861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e006f-f820-40ae-954e-65ceee5e0459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.877544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e006f-f820-40ae-954e-65ceee5e0459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.877799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e006f-f820-40ae-954e-65ceee5e0459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.878019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9c7d3-14d3-41a8-9009-57fe08fd7e95 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:56.878127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e006f-f820-40ae-954e-65ceee5e0459 admin admin] PATH_INFO: `/v3/projects/3028ae6ba7df458080081ede634e4102/users/5f42e0111be048048bf3a0aa33e4ede9/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.884583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6316d6-5a5e-408a-9e6a-ef761dc6e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:56.885528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6316d6-5a5e-408a-9e6a-ef761dc6e9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:56.885809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6316d6-5a5e-408a-9e6a-ef761dc6e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:56.886097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6316d6-5a5e-408a-9e6a-ef761dc6e9ed admin admin] PATH_INFO: `/v3/projects/a9f108fadc514e90a02244bde8fcb3ec/users/26bcecc660c54eb08f887dc9f6325a70/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:56.894174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e006f-f820-40ae-954e-65ceee5e0459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3028ae6ba7df458080081ede634e4102, user_id=5f42e0111be048048bf3a0aa33e4ede9, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.895422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING py.warnings [None req-847e006f-f820-40ae-954e-65ceee5e0459 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:39:56.895422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: warnings.warn(msg) Aug 02 21:39:56.895422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: Aug 02 21:39:56.897754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e006f-f820-40ae-954e-65ceee5e0459 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.902481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=12,keystone:SELECT=88 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:56.906423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6316d6-5a5e-408a-9e6a-ef761dc6e9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f108fadc514e90a02244bde8fcb3ec, user_id=26bcecc660c54eb08f887dc9f6325a70, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:56.909903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6316d6-5a5e-408a-9e6a-ef761dc6e9ed admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:56.915461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 793/1599] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:56 2022] PUT /identity/v3/projects/3028ae6ba7df458080081ede634e4102/users/5f42e0111be048048bf3a0aa33e4ede9/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:56.916898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e006f-f820-40ae-954e-65ceee5e0459 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:56.928929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 807/1600] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:56 2022] PUT /identity/v3/projects/a9f108fadc514e90a02244bde8fcb3ec/users/26bcecc660c54eb08f887dc9f6325a70/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:56.930095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6316d6-5a5e-408a-9e6a-ef761dc6e9ed admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.003575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e006f-f820-40ae-954e-65ceee5e0459 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.009426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e72df5-c1b5-4afd-b85f-0222a9f48bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.010049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e72df5-c1b5-4afd-b85f-0222a9f48bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.010320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e72df5-c1b5-4afd-b85f-0222a9f48bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.010588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e72df5-c1b5-4afd-b85f-0222a9f48bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.011288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e72df5-c1b5-4afd-b85f-0222a9f48bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.012961 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e72df5-c1b5-4afd-b85f-0222a9f48bbd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.013998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6316d6-5a5e-408a-9e6a-ef761dc6e9ed admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.022938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61a253-43ff-49ed-ac17-0539ef90e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.023996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61a253-43ff-49ed-ac17-0539ef90e9ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.024871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61a253-43ff-49ed-ac17-0539ef90e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.025038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 794/1601] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:57.025178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61a253-43ff-49ed-ac17-0539ef90e9ed admin admin] PATH_INFO: `/v3/projects/80128fa0bb36449682b56634f82e78b2/users/4e09723da5824c2e8d7321d84a4b6bf4/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.026077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc21b3-eb91-4d6d-9d30-257bc86d5c9a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.026362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc21b3-eb91-4d6d-9d30-257bc86d5c9a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.026637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc21b3-eb91-4d6d-9d30-257bc86d5c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.046002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-68fc21b3-eb91-4d6d-9d30-257bc86d5c9a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:57.047135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61a253-43ff-49ed-ac17-0539ef90e9ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=80128fa0bb36449682b56634f82e78b2, user_id=4e09723da5824c2e8d7321d84a4b6bf4, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.047268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-68fc21b3-eb91-4d6d-9d30-257bc86d5c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:57.050118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb61a253-43ff-49ed-ac17-0539ef90e9ed admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.055142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 795/1602] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:57.056850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc21b3-eb91-4d6d-9d30-257bc86d5c9a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.066697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc21b3-eb91-4d6d-9d30-257bc86d5c9a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.074890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 808/1603] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:56 2022] PUT /identity/v3/projects/80128fa0bb36449682b56634f82e78b2/users/4e09723da5824c2e8d7321d84a4b6bf4/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:57.076142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61a253-43ff-49ed-ac17-0539ef90e9ed admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.135985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86c5a-3fe3-4064-98c7-ae430f4ec3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.136687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86c5a-3fe3-4064-98c7-ae430f4ec3dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.136862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86c5a-3fe3-4064-98c7-ae430f4ec3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.137138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86c5a-3fe3-4064-98c7-ae430f4ec3dd admin admin] PATH_INFO: `/v3/projects/6c98a5a02318476daf8318190d7e1a76/users/3d13a56d271447bb936cea12e693b22f/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.143063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61a253-43ff-49ed-ac17-0539ef90e9ed admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.148681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85797ea-d6b6-421e-a2d9-d6d352af73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.149502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85797ea-d6b6-421e-a2d9-d6d352af73a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.149794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85797ea-d6b6-421e-a2d9-d6d352af73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.150371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85797ea-d6b6-421e-a2d9-d6d352af73a9 admin admin] PATH_INFO: `/v3/projects/db10ea2b998a41a7bdab830a2d221f4e/users/9ef38c123f504bcf9150a1b3f44cb5e6/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.161491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e86c5a-3fe3-4064-98c7-ae430f4ec3dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c98a5a02318476daf8318190d7e1a76, user_id=3d13a56d271447bb936cea12e693b22f, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.164191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e86c5a-3fe3-4064-98c7-ae430f4ec3dd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.177554 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85797ea-d6b6-421e-a2d9-d6d352af73a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db10ea2b998a41a7bdab830a2d221f4e, user_id=9ef38c123f504bcf9150a1b3f44cb5e6, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.180299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85797ea-d6b6-421e-a2d9-d6d352af73a9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.183567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 796/1604] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:57 2022] PUT /identity/v3/projects/6c98a5a02318476daf8318190d7e1a76/users/3d13a56d271447bb936cea12e693b22f/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:57.184982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f88d-cee7-49c2-a805-b0c4692ff5cf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.185276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f88d-cee7-49c2-a805-b0c4692ff5cf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.185553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415f88d-cee7-49c2-a805-b0c4692ff5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.219498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4415f88d-cee7-49c2-a805-b0c4692ff5cf None None] MFA Rules not processed for user `5f42e0111be048048bf3a0aa33e4ede9`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:57.222568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 809/1605] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:57 2022] PUT /identity/v3/projects/db10ea2b998a41a7bdab830a2d221f4e/users/9ef38c123f504bcf9150a1b3f44cb5e6/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:57.223529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fed44-a70a-400c-9384-20d5e730e801 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.223812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fed44-a70a-400c-9384-20d5e730e801 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.224196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fed44-a70a-400c-9384-20d5e730e801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.225527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4415f88d-cee7-49c2-a805-b0c4692ff5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:57.234495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:57.266828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-cd2fed44-a70a-400c-9384-20d5e730e801 None None] MFA Rules not processed for user `26bcecc660c54eb08f887dc9f6325a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:57.268160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cd2fed44-a70a-400c-9384-20d5e730e801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:57.309064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 797/1606] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:57.309978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f88d-cee7-49c2-a805-b0c4692ff5cf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.332266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:57.357106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 810/1607] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:57.361238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fed44-a70a-400c-9384-20d5e730e801 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.409130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415f88d-cee7-49c2-a805-b0c4692ff5cf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.414828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2c7d8-d9e2-43f5-8228-95fe3e2a6d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.416067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2c7d8-d9e2-43f5-8228-95fe3e2a6d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.416454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2c7d8-d9e2-43f5-8228-95fe3e2a6d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.417243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2c7d8-d9e2-43f5-8228-95fe3e2a6d4d admin admin] PATH_INFO: `/v3/projects/522def96635b48a59492fb7083c3c842/users/57e8eced4d8d49458668a52761e9b8bb/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.427987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fed44-a70a-400c-9384-20d5e730e801 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.432311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2898c7-2779-46ac-9491-bc11cd66248b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.433031 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2898c7-2779-46ac-9491-bc11cd66248b service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.433380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2898c7-2779-46ac-9491-bc11cd66248b service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.433723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2898c7-2779-46ac-9491-bc11cd66248b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.434960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2c7d8-d9e2-43f5-8228-95fe3e2a6d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=522def96635b48a59492fb7083c3c842, user_id=57e8eced4d8d49458668a52761e9b8bb, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.437688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2c7d8-d9e2-43f5-8228-95fe3e2a6d4d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.443305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2898c7-2779-46ac-9491-bc11cd66248b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.444888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2898c7-2779-46ac-9491-bc11cd66248b service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.451739 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 798/1608] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:57 2022] PUT /identity/v3/projects/522def96635b48a59492fb7083c3c842/users/57e8eced4d8d49458668a52761e9b8bb/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:57.455611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 811/1609] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:57.455962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd149b-9720-4098-b2e5-ed61989a0d42 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.456316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd149b-9720-4098-b2e5-ed61989a0d42 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.456583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd149b-9720-4098-b2e5-ed61989a0d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.457458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd3b49-ee9b-4d98-a78d-dcfe3806440e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.457753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd3b49-ee9b-4d98-a78d-dcfe3806440e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.458029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbd3b49-ee9b-4d98-a78d-dcfe3806440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.477021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f6bd149b-9720-4098-b2e5-ed61989a0d42 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:57.477483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0fbd3b49-ee9b-4d98-a78d-dcfe3806440e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:57.478310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f6bd149b-9720-4098-b2e5-ed61989a0d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:57.478927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0fbd3b49-ee9b-4d98-a78d-dcfe3806440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:57.546635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 799/1610] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:57.548243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724dbf-a235-4754-9b2f-f3438eb8a12f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.548540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724dbf-a235-4754-9b2f-f3438eb8a12f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.548837 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52724dbf-a235-4754-9b2f-f3438eb8a12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.552818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 812/1611] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:57.553431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7e39-f3ae-4163-8911-114bac69c4cf None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.553803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7e39-f3ae-4163-8911-114bac69c4cf None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.554506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff7e39-f3ae-4163-8911-114bac69c4cf None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.556350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 813/1612] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 2 21:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:57.558718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7e39-f3ae-4163-8911-114bac69c4cf None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.572773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff7e39-f3ae-4163-8911-114bac69c4cf None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.577901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca342d1b-51c1-43ce-8be8-1584d3776aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.578540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca342d1b-51c1-43ce-8be8-1584d3776aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.578821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca342d1b-51c1-43ce-8be8-1584d3776aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.579090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca342d1b-51c1-43ce-8be8-1584d3776aa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.579750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca342d1b-51c1-43ce-8be8-1584d3776aa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.581841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca342d1b-51c1-43ce-8be8-1584d3776aa9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.587205 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-52724dbf-a235-4754-9b2f-f3438eb8a12f None None] MFA Rules not processed for user `9ef38c123f504bcf9150a1b3f44cb5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:57.588543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-52724dbf-a235-4754-9b2f-f3438eb8a12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:57.609382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:57.614055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 814/1613] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:57.615268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3429d-6980-40d1-bb74-83d1d3dd983a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.615652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3429d-6980-40d1-bb74-83d1d3dd983a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.616055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3429d-6980-40d1-bb74-83d1d3dd983a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.639130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-32c3429d-6980-40d1-bb74-83d1d3dd983a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:57.640511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-32c3429d-6980-40d1-bb74-83d1d3dd983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:57.667312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 800/1614] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:57.669827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4d10e-4bfd-46bd-b454-d4a4d2e671a0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.670309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4d10e-4bfd-46bd-b454-d4a4d2e671a0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.670835 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4d10e-4bfd-46bd-b454-d4a4d2e671a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.716101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9cd4d10e-4bfd-46bd-b454-d4a4d2e671a0 None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:57.717805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9cd4d10e-4bfd-46bd-b454-d4a4d2e671a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:57.728009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 815/1615] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:57.729336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3429d-6980-40d1-bb74-83d1d3dd983a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.732645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-32c3429d-6980-40d1-bb74-83d1d3dd983a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:57.746856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:57.801391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 801/1616] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:57.802095 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4d10e-4bfd-46bd-b454-d4a4d2e671a0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.811296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3429d-6980-40d1-bb74-83d1d3dd983a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.818143 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4d10e-4bfd-46bd-b454-d4a4d2e671a0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.818818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200c715-0b4d-40bb-b0eb-61ff420b94bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.819745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200c715-0b4d-40bb-b0eb-61ff420b94bb service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.820319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200c715-0b4d-40bb-b0eb-61ff420b94bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.820727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200c715-0b4d-40bb-b0eb-61ff420b94bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.823826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29309b-f893-47d6-b7c9-ebf9f939bdc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.824542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29309b-f893-47d6-b7c9-ebf9f939bdc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.824838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29309b-f893-47d6-b7c9-ebf9f939bdc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.825099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29309b-f893-47d6-b7c9-ebf9f939bdc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.831695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200c715-0b4d-40bb-b0eb-61ff420b94bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.833244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200c715-0b4d-40bb-b0eb-61ff420b94bb service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.836527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29309b-f893-47d6-b7c9-ebf9f939bdc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.838991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29309b-f893-47d6-b7c9-ebf9f939bdc7 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.844649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 816/1617] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:57.848902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200c715-0b4d-40bb-b0eb-61ff420b94bb service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.850847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 802/1618] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:57.851608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29309b-f893-47d6-b7c9-ebf9f939bdc7 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.860980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200c715-0b4d-40bb-b0eb-61ff420b94bb service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.861710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29309b-f893-47d6-b7c9-ebf9f939bdc7 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.866641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7a149-31c2-4a31-8a3f-e923e49d5046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.867264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7a149-31c2-4a31-8a3f-e923e49d5046 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.867398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe3e73-49a4-46ec-9dee-d3da2bc5b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.867543 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7a149-31c2-4a31-8a3f-e923e49d5046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.867849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7a149-31c2-4a31-8a3f-e923e49d5046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.868277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe3e73-49a4-46ec-9dee-d3da2bc5b5c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.868587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7a149-31c2-4a31-8a3f-e923e49d5046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.868718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe3e73-49a4-46ec-9dee-d3da2bc5b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.869081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe3e73-49a4-46ec-9dee-d3da2bc5b5c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:57.869809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe3e73-49a4-46ec-9dee-d3da2bc5b5c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:57.871289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7a149-31c2-4a31-8a3f-e923e49d5046 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.872247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe3e73-49a4-46ec-9dee-d3da2bc5b5c5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:57.906854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 817/1619] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/users => generated 296 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:57.907894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe3e73-49a4-46ec-9dee-d3da2bc5b5c5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.916777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 803/1620] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:39:57 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:57.917849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7a149-31c2-4a31-8a3f-e923e49d5046 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:57.924845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe3e73-49a4-46ec-9dee-d3da2bc5b5c5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:57.989738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2e41c-2ef9-4a19-beb2-1cc4a35a7536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:57.990425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2e41c-2ef9-4a19-beb2-1cc4a35a7536 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:57.990710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2e41c-2ef9-4a19-beb2-1cc4a35a7536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:57.990986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2e41c-2ef9-4a19-beb2-1cc4a35a7536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.009656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:58.018450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7a149-31c2-4a31-8a3f-e923e49d5046 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.029608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038f0ff-6a65-4077-a73c-d0c3b7f96981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.030305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038f0ff-6a65-4077-a73c-d0c3b7f96981 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.030744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038f0ff-6a65-4077-a73c-d0c3b7f96981 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.031104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038f0ff-6a65-4077-a73c-d0c3b7f96981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.066311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2e41c-2ef9-4a19-beb2-1cc4a35a7536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.068232 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2e41c-2ef9-4a19-beb2-1cc4a35a7536 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.080077 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 818/1621] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:58.080875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2e41c-2ef9-4a19-beb2-1cc4a35a7536 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.090364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2e41c-2ef9-4a19-beb2-1cc4a35a7536 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.095607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b69ac-1728-4d61-aa99-60e70e896bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.096265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b69ac-1728-4d61-aa99-60e70e896bab admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.096549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b69ac-1728-4d61-aa99-60e70e896bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.096823 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b69ac-1728-4d61-aa99-60e70e896bab admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.097690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b69ac-1728-4d61-aa99-60e70e896bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.099122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b69ac-1728-4d61-aa99-60e70e896bab admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.100179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038f0ff-6a65-4077-a73c-d0c3b7f96981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.101852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038f0ff-6a65-4077-a73c-d0c3b7f96981 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.110008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 819/1622] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:58.110831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b69ac-1728-4d61-aa99-60e70e896bab admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.119376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 804/1623] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:58.120645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038f0ff-6a65-4077-a73c-d0c3b7f96981 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.121888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b69ac-1728-4d61-aa99-60e70e896bab admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.127254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df98f49-c8a5-4ecf-a7d2-b3706ad88390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.129039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df98f49-c8a5-4ecf-a7d2-b3706ad88390 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.129332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df98f49-c8a5-4ecf-a7d2-b3706ad88390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.129724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df98f49-c8a5-4ecf-a7d2-b3706ad88390 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.130617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df98f49-c8a5-4ecf-a7d2-b3706ad88390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.133009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df98f49-c8a5-4ecf-a7d2-b3706ad88390 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.133677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038f0ff-6a65-4077-a73c-d0c3b7f96981 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.139095 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688a3fe-c430-4685-b45e-dea22cc6fe1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.139764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688a3fe-c430-4685-b45e-dea22cc6fe1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.140036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688a3fe-c430-4685-b45e-dea22cc6fe1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.140361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2688a3fe-c430-4685-b45e-dea22cc6fe1b admin admin] PATH_INFO: `/v3/projects/54d7a88d022b4bc0a871e893f3193772/users/4dec05fbd5fc49d8a1cc9c82221ca178/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.168462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688a3fe-c430-4685-b45e-dea22cc6fe1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d7a88d022b4bc0a871e893f3193772, user_id=4dec05fbd5fc49d8a1cc9c82221ca178, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.170448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 820/1624] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:39:58 2022] POST /identity/v3/users => generated 292 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:39:58.173453 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2688a3fe-c430-4685-b45e-dea22cc6fe1b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.174877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df98f49-c8a5-4ecf-a7d2-b3706ad88390 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.188766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df98f49-c8a5-4ecf-a7d2-b3706ad88390 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.194154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 805/1625] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:58 2022] PUT /identity/v3/projects/54d7a88d022b4bc0a871e893f3193772/users/4dec05fbd5fc49d8a1cc9c82221ca178/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:58.195400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688a3fe-c430-4685-b45e-dea22cc6fe1b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.207338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:58.273908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147acc2-a68d-415b-abba-0a1e888e9e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.276122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147acc2-a68d-415b-abba-0a1e888e9e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.276621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147acc2-a68d-415b-abba-0a1e888e9e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.276979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6147acc2-a68d-415b-abba-0a1e888e9e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.278388 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147acc2-a68d-415b-abba-0a1e888e9e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.280491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6147acc2-a68d-415b-abba-0a1e888e9e8d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.295255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 821/1626] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:58.296453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147acc2-a68d-415b-abba-0a1e888e9e8d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.297548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2688a3fe-c430-4685-b45e-dea22cc6fe1b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.304865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048bdbc-0a13-46fc-afef-90da8e5487c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.306382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048bdbc-0a13-46fc-afef-90da8e5487c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.306662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048bdbc-0a13-46fc-afef-90da8e5487c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.306932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048bdbc-0a13-46fc-afef-90da8e5487c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.307788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048bdbc-0a13-46fc-afef-90da8e5487c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.308412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6147acc2-a68d-415b-abba-0a1e888e9e8d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.309705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048bdbc-0a13-46fc-afef-90da8e5487c0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.313962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad82b-7294-4c8b-956c-48919025ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.314713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad82b-7294-4c8b-956c-48919025ec2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.315065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad82b-7294-4c8b-956c-48919025ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.315414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ad82b-7294-4c8b-956c-48919025ec2c admin admin] PATH_INFO: `/v3/projects/1b9831a2f2f9417e84d90f9104a0b771/users/9d255cc303504d53a6df4eecd45014a7/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.328839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 806/1627] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:58.330895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048bdbc-0a13-46fc-afef-90da8e5487c0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.340810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ad82b-7294-4c8b-956c-48919025ec2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9831a2f2f9417e84d90f9104a0b771, user_id=9d255cc303504d53a6df4eecd45014a7, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.344023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ad82b-7294-4c8b-956c-48919025ec2c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.346369 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048bdbc-0a13-46fc-afef-90da8e5487c0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.354038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed0e4e-c9f5-4324-80f0-63541a4cde96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.355191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed0e4e-c9f5-4324-80f0-63541a4cde96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.355564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed0e4e-c9f5-4324-80f0-63541a4cde96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.355895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed0e4e-c9f5-4324-80f0-63541a4cde96 admin admin] PATH_INFO: `/v3/projects/54d7a88d022b4bc0a871e893f3193772/users/4dec05fbd5fc49d8a1cc9c82221ca178/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.358570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed0e4e-c9f5-4324-80f0-63541a4cde96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d7a88d022b4bc0a871e893f3193772, user_id=4dec05fbd5fc49d8a1cc9c82221ca178, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.362890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed0e4e-c9f5-4324-80f0-63541a4cde96 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.369318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 822/1628] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:58 2022] PUT /identity/v3/projects/1b9831a2f2f9417e84d90f9104a0b771/users/9d255cc303504d53a6df4eecd45014a7/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:58.375584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad82b-7294-4c8b-956c-48919025ec2c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.378768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 807/1629] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:58 2022] PUT /identity/v3/projects/54d7a88d022b4bc0a871e893f3193772/users/4dec05fbd5fc49d8a1cc9c82221ca178/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:58.380405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154590-4015-458e-baf5-dfd352366d67 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.380866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154590-4015-458e-baf5-dfd352366d67 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.381381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7154590-4015-458e-baf5-dfd352366d67 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.384292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 808/1630] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 2 21:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:58.390708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06b5b-f674-4d07-9f72-35ae419afcf5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.392039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06b5b-f674-4d07-9f72-35ae419afcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.392554 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d06b5b-f674-4d07-9f72-35ae419afcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.449240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e1d06b5b-f674-4d07-9f72-35ae419afcf5 None None] MFA Rules not processed for user `4dec05fbd5fc49d8a1cc9c82221ca178`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:58.451253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e1d06b5b-f674-4d07-9f72-35ae419afcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:58.476157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ad82b-7294-4c8b-956c-48919025ec2c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.519664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:58.552598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 809/1631] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:39:58.552792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135b2a3-6ebd-4efc-b73a-a6276b36490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.552898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08fc8f-8915-4525-8f31-fc4240bfa012 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.552898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08fc8f-8915-4525-8f31-fc4240bfa012 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.553074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135b2a3-6ebd-4efc-b73a-a6276b36490a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.553159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08fc8f-8915-4525-8f31-fc4240bfa012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.553264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135b2a3-6ebd-4efc-b73a-a6276b36490a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.553264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135b2a3-6ebd-4efc-b73a-a6276b36490a admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.553264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135b2a3-6ebd-4efc-b73a-a6276b36490a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.553512 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135b2a3-6ebd-4efc-b73a-a6276b36490a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.569485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 823/1632] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:39:58 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:39:58.570298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135b2a3-6ebd-4efc-b73a-a6276b36490a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.585869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cb08fc8f-8915-4525-8f31-fc4240bfa012 None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:58.587360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cb08fc8f-8915-4525-8f31-fc4240bfa012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:58.623558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:58.653221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135b2a3-6ebd-4efc-b73a-a6276b36490a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.657350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692b34f-7cb4-4f7e-ad5f-018d2d2619cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.658341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692b34f-7cb4-4f7e-ad5f-018d2d2619cb service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.658694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692b34f-7cb4-4f7e-ad5f-018d2d2619cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.659006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692b34f-7cb4-4f7e-ad5f-018d2d2619cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.670882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 810/1633] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:58.671067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692b34f-7cb4-4f7e-ad5f-018d2d2619cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.672336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692b34f-7cb4-4f7e-ad5f-018d2d2619cb service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.673723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08fc8f-8915-4525-8f31-fc4240bfa012 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.685177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 824/1634] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:58 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:58.686305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692b34f-7cb4-4f7e-ad5f-018d2d2619cb service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.691870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08fc8f-8915-4525-8f31-fc4240bfa012 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.696277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692b34f-7cb4-4f7e-ad5f-018d2d2619cb service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.699383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454c5f9-62b9-4033-9489-f4d54368a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.701544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454c5f9-62b9-4033-9489-f4d54368a6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.701666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ea81-ecca-44d8-8a05-45a6bfe67e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:58.701863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454c5f9-62b9-4033-9489-f4d54368a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.702193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ea81-ecca-44d8-8a05-45a6bfe67e49 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.702301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454c5f9-62b9-4033-9489-f4d54368a6fa admin admin] PATH_INFO: `/v3/projects/1b9831a2f2f9417e84d90f9104a0b771/users/9d255cc303504d53a6df4eecd45014a7/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.702474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ea81-ecca-44d8-8a05-45a6bfe67e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.702799 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9ea81-ecca-44d8-8a05-45a6bfe67e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.704831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454c5f9-62b9-4033-9489-f4d54368a6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9831a2f2f9417e84d90f9104a0b771, user_id=9d255cc303504d53a6df4eecd45014a7, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.708641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454c5f9-62b9-4033-9489-f4d54368a6fa admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.725898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9ea81-ecca-44d8-8a05-45a6bfe67e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:58.728567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd9ea81-ecca-44d8-8a05-45a6bfe67e49 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:58.730649 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 811/1635] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:39:58 2022] PUT /identity/v3/projects/1b9831a2f2f9417e84d90f9104a0b771/users/9d255cc303504d53a6df4eecd45014a7/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:39:58.741155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a60e7-5061-4ec7-979d-6afe75766daf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:58.741445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a60e7-5061-4ec7-979d-6afe75766daf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:58.741727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a60e7-5061-4ec7-979d-6afe75766daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:58.750324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 825/1636] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:58.785034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f91a60e7-5061-4ec7-979d-6afe75766daf None None] MFA Rules not processed for user `9d255cc303504d53a6df4eecd45014a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:58.787152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f91a60e7-5061-4ec7-979d-6afe75766daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:58.854521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ea81-ecca-44d8-8a05-45a6bfe67e49 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:58.866168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9ea81-ecca-44d8-8a05-45a6bfe67e49 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:58.892663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 812/1637] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:39:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:39:59.032992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbd3f1-0ec3-49f4-af17-03ef7ff052e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:59.033723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd3f1-0ec3-49f4-af17-03ef7ff052e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:59.034023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd3f1-0ec3-49f4-af17-03ef7ff052e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:59.034300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbd3f1-0ec3-49f4-af17-03ef7ff052e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:59.155910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbd3f1-0ec3-49f4-af17-03ef7ff052e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:59.157414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbd3f1-0ec3-49f4-af17-03ef7ff052e9 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:59.177273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a60e7-5061-4ec7-979d-6afe75766daf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:59.179183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 826/1638] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:39:59.190859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a60e7-5061-4ec7-979d-6afe75766daf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:59.195013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a0e05-4d62-47e9-b12c-ea8b1a09fc91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:59.195646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a0e05-4d62-47e9-b12c-ea8b1a09fc91 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:59.195994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a0e05-4d62-47e9-b12c-ea8b1a09fc91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:59.196387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a0e05-4d62-47e9-b12c-ea8b1a09fc91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:59.220422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a0e05-4d62-47e9-b12c-ea8b1a09fc91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:59.221970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a0e05-4d62-47e9-b12c-ea8b1a09fc91 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:59.256443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 813/1639] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:59.612337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbd3f1-0ec3-49f4-af17-03ef7ff052e9 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:59.623689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbd3f1-0ec3-49f4-af17-03ef7ff052e9 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:59.636360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cc99a-890a-4683-84e5-feae35916341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:59.637263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cc99a-890a-4683-84e5-feae35916341 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:59.638035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cc99a-890a-4683-84e5-feae35916341 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:59.639116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cc99a-890a-4683-84e5-feae35916341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:59.808842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cc99a-890a-4683-84e5-feae35916341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:59.810854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cc99a-890a-4683-84e5-feae35916341 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:59.823676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 827/1640] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:59.849463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641b63-f762-4dc4-b62c-bc648ba98a6d None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:59.850106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641b63-f762-4dc4-b62c-bc648ba98a6d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:59.850536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c641b63-f762-4dc4-b62c-bc648ba98a6d None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:59.853031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 814/1641] 10.222.0.57 () {54 vars in 962 bytes} [Tue Aug 2 21:39:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:59.866630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d532a-8cae-4a4c-b11d-33ad16d1077b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:59.866630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d532a-8cae-4a4c-b11d-33ad16d1077b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:59.866630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d532a-8cae-4a4c-b11d-33ad16d1077b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:59.895853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d17d532a-8cae-4a4c-b11d-33ad16d1077b None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:59.897881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d17d532a-8cae-4a4c-b11d-33ad16d1077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:59.909940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:00.061857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 828/1642] 10.222.0.57 () {58 vars in 1059 bytes} [Tue Aug 2 21:39:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:00.072266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af9332-b824-4da0-b00b-fb44f1e29436 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:00.072842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af9332-b824-4da0-b00b-fb44f1e29436 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:00.073312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af9332-b824-4da0-b00b-fb44f1e29436 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:00.075429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 815/1643] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 2 21:40:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:40:00.086026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b264-e6b4-45de-9850-2540233643ba None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:00.086681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b264-e6b4-45de-9850-2540233643ba None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:00.087189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839b264-e6b4-45de-9850-2540233643ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:00.141162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e839b264-e6b4-45de-9850-2540233643ba None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:00.147832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e839b264-e6b4-45de-9850-2540233643ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:00.184617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 829/1644] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:40:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:00.202659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af9332-b824-4da0-b00b-fb44f1e29436 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:00.221113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af9332-b824-4da0-b00b-fb44f1e29436 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:00.228681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cc4d2-9e88-4708-a45f-4d719cc5234a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:00.231125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cc4d2-9e88-4708-a45f-4d719cc5234a service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:00.231654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cc4d2-9e88-4708-a45f-4d719cc5234a service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:00.232037 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cc4d2-9e88-4708-a45f-4d719cc5234a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:00.250989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cc4d2-9e88-4708-a45f-4d719cc5234a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:00.252856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cc4d2-9e88-4708-a45f-4d719cc5234a service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:00.289214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 816/1645] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:08.417943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9824ce-8594-48a0-b5d4-1355fed4f317 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:08.418355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9824ce-8594-48a0-b5d4-1355fed4f317 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:08.418507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9824ce-8594-48a0-b5d4-1355fed4f317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:08.499851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-fa9824ce-8594-48a0-b5d4-1355fed4f317 None None] MFA Rules not processed for user `3d13a56d271447bb936cea12e693b22f`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:08.499851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fa9824ce-8594-48a0-b5d4-1355fed4f317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:08.698659 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 830/1646] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:08.714702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cc4d2-9e88-4708-a45f-4d719cc5234a service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:08.734626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cc4d2-9e88-4708-a45f-4d719cc5234a service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:08.756576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f9047-6523-4bbd-8aaf-3b37fd008086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:08.757394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f9047-6523-4bbd-8aaf-3b37fd008086 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:08.757838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f9047-6523-4bbd-8aaf-3b37fd008086 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:08.758279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f9047-6523-4bbd-8aaf-3b37fd008086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:08.796722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f9047-6523-4bbd-8aaf-3b37fd008086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:08.803939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f9047-6523-4bbd-8aaf-3b37fd008086 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:08.852514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 817/1647] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:10.937490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9a35-a670-4375-aa79-6da5a49b82f2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:10.937980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9a35-a670-4375-aa79-6da5a49b82f2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:10.938056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cd9a35-a670-4375-aa79-6da5a49b82f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:11.029177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-67cd9a35-a670-4375-aa79-6da5a49b82f2 None None] MFA Rules not processed for user `e477f5953a534355b29c071086846ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:11.031057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-67cd9a35-a670-4375-aa79-6da5a49b82f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:11.230008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 831/1648] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:11.252793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c5048-01cd-4aed-a365-b4923873da78 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:11.253248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c5048-01cd-4aed-a365-b4923873da78 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:11.253316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c5048-01cd-4aed-a365-b4923873da78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:11.257015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd9a35-a670-4375-aa79-6da5a49b82f2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:11.295507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cd9a35-a670-4375-aa79-6da5a49b82f2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:11.323380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16532862-8280-4014-8e28-991abee5273e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:11.324023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16532862-8280-4014-8e28-991abee5273e service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:11.324330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16532862-8280-4014-8e28-991abee5273e service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:11.324596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16532862-8280-4014-8e28-991abee5273e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:11.326829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:11.363762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e02c5048-01cd-4aed-a365-b4923873da78 None None] MFA Rules not processed for user `4e09723da5824c2e8d7321d84a4b6bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:11.365035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e02c5048-01cd-4aed-a365-b4923873da78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:11.368330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16532862-8280-4014-8e28-991abee5273e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:11.370025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16532862-8280-4014-8e28-991abee5273e service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:11.401036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 832/1649] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:11.560760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 818/1650] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:11.570925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157326ec-e064-429d-8eb2-9d919eca57a5 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:11.571211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157326ec-e064-429d-8eb2-9d919eca57a5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:11.571482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157326ec-e064-429d-8eb2-9d919eca57a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:11.580711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:11.596242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-157326ec-e064-429d-8eb2-9d919eca57a5 None None] MFA Rules not processed for user `4e09723da5824c2e8d7321d84a4b6bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:11.597470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-157326ec-e064-429d-8eb2-9d919eca57a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:11.610526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 833/1651] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:11.622200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c5048-01cd-4aed-a365-b4923873da78 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:11.644067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c5048-01cd-4aed-a365-b4923873da78 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:11.670104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff202e2-28b7-464b-ab1d-9c67fc647b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:11.670748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff202e2-28b7-464b-ab1d-9c67fc647b18 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:11.671020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff202e2-28b7-464b-ab1d-9c67fc647b18 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:11.674147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff202e2-28b7-464b-ab1d-9c67fc647b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:11.695843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff202e2-28b7-464b-ab1d-9c67fc647b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:11.700410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff202e2-28b7-464b-ab1d-9c67fc647b18 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:11.738750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 819/1652] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:12.533663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5bb61-6c42-4bf5-9fc4-0ec233e33fb8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:12.534115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5bb61-6c42-4bf5-9fc4-0ec233e33fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:12.534290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d5bb61-6c42-4bf5-9fc4-0ec233e33fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:12.617711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-00d5bb61-6c42-4bf5-9fc4-0ec233e33fb8 None None] MFA Rules not processed for user `57e8eced4d8d49458668a52761e9b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:12.619211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-00d5bb61-6c42-4bf5-9fc4-0ec233e33fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:12.812458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 834/1653] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:12.825781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff202e2-28b7-464b-ab1d-9c67fc647b18 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:12.841899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff202e2-28b7-464b-ab1d-9c67fc647b18 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:12.857472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e3c3a-66a8-4943-8453-31fe30805d66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:12.857472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e3c3a-66a8-4943-8453-31fe30805d66 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:12.857472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e3c3a-66a8-4943-8453-31fe30805d66 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:12.857472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e3c3a-66a8-4943-8453-31fe30805d66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:12.880545 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e3c3a-66a8-4943-8453-31fe30805d66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:12.882225 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e3c3a-66a8-4943-8453-31fe30805d66 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:12.904564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 820/1654] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:13.349577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd983f-f4b2-4243-98e2-b7479c363d50 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:13.349870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd983f-f4b2-4243-98e2-b7479c363d50 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:13.350147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd983f-f4b2-4243-98e2-b7479c363d50 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:13.352111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 835/1655] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 2 21:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:40:13.360870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3bbd3-f1a0-40ed-bf45-7295b6603565 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:13.361408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3bbd3-f1a0-40ed-bf45-7295b6603565 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:13.361874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3bbd3-f1a0-40ed-bf45-7295b6603565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:13.449023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f4b3bbd3-f1a0-40ed-bf45-7295b6603565 None None] MFA Rules not processed for user `24644cede7e149a6b3e5bd39b930017b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:13.451669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f4b3bbd3-f1a0-40ed-bf45-7295b6603565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:13.633610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 821/1656] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:13.692419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd983f-f4b2-4243-98e2-b7479c363d50 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:13.711192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd983f-f4b2-4243-98e2-b7479c363d50 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:13.728486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ccfd8-77f2-4106-9aab-441e12d5359c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:13.732375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ccfd8-77f2-4106-9aab-441e12d5359c service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:13.732773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ccfd8-77f2-4106-9aab-441e12d5359c service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:13.733027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ccfd8-77f2-4106-9aab-441e12d5359c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:13.751780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ccfd8-77f2-4106-9aab-441e12d5359c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:13.766195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ccfd8-77f2-4106-9aab-441e12d5359c service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:13.816286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 836/1657] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:14.632279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599336c-5779-4fd0-b414-56e0d37f1c80 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:14.633887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599336c-5779-4fd0-b414-56e0d37f1c80 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:14.634179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599336c-5779-4fd0-b414-56e0d37f1c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:14.697663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7599336c-5779-4fd0-b414-56e0d37f1c80 None None] MFA Rules not processed for user `3d13a56d271447bb936cea12e693b22f`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:14.701110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7599336c-5779-4fd0-b414-56e0d37f1c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:14.742626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 822/1658] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:15.371582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd651f02-98f5-4340-bf99-40df9cb116bf None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:15.372609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd651f02-98f5-4340-bf99-40df9cb116bf None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:15.373024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd651f02-98f5-4340-bf99-40df9cb116bf None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:15.374934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 837/1659] 10.222.0.57 () {54 vars in 961 bytes} [Tue Aug 2 21:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:40:15.389680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736081ec-226a-4a42-8d43-bfa5bfda2850 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:15.389970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736081ec-226a-4a42-8d43-bfa5bfda2850 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:15.390246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736081ec-226a-4a42-8d43-bfa5bfda2850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:15.430477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-736081ec-226a-4a42-8d43-bfa5bfda2850 None None] MFA Rules not processed for user `ad52cba0b761482d96b6659654034ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:15.431794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-736081ec-226a-4a42-8d43-bfa5bfda2850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:15.602242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:15.632434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd651f02-98f5-4340-bf99-40df9cb116bf None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:15.634783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 823/1660] 10.222.0.57 () {58 vars in 1058 bytes} [Tue Aug 2 21:40:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:15.659951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd651f02-98f5-4340-bf99-40df9cb116bf None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:15.669646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05b85d-9c18-42a7-a26c-e55eb3d713dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:15.672553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05b85d-9c18-42a7-a26c-e55eb3d713dd service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:15.673005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05b85d-9c18-42a7-a26c-e55eb3d713dd service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:15.674575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05b85d-9c18-42a7-a26c-e55eb3d713dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:15.678171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7d05b85d-9c18-42a7-a26c-e55eb3d713dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:15.710861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05b85d-9c18-42a7-a26c-e55eb3d713dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:15.713057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05b85d-9c18-42a7-a26c-e55eb3d713dd service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:15.732066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 838/1661] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:16.401848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f411a-a81a-4b29-b787-b576ed0da756 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:16.402714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f411a-a81a-4b29-b787-b576ed0da756 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:16.403140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f411a-a81a-4b29-b787-b576ed0da756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:16.437437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be2183-96ef-4779-9f86-c1503157f105 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:16.438428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be2183-96ef-4779-9f86-c1503157f105 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:16.438884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be2183-96ef-4779-9f86-c1503157f105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:16.443972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a61f411a-a81a-4b29-b787-b576ed0da756 None None] MFA Rules not processed for user `57e8eced4d8d49458668a52761e9b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:16.446539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a61f411a-a81a-4b29-b787-b576ed0da756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:16.456618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 824/1662] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:16.458125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f9e35-3c13-4eff-90f1-2eb11265b742 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:16.458589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f9e35-3c13-4eff-90f1-2eb11265b742 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:16.459035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f9e35-3c13-4eff-90f1-2eb11265b742 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:16.460634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 825/1663] 10.222.0.57 () {54 vars in 912 bytes} [Tue Aug 2 21:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:40:16.468465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e0a8-b975-48c9-9d31-59ee601cc31f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:16.468888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e0a8-b975-48c9-9d31-59ee601cc31f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:16.469375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a1e0a8-b975-48c9-9d31-59ee601cc31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:16.476085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-65be2183-96ef-4779-9f86-c1503157f105 None None] MFA Rules not processed for user `e477f5953a534355b29c071086846ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:16.477389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-65be2183-96ef-4779-9f86-c1503157f105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:16.486229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 839/1664] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:16.499024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-80a1e0a8-b975-48c9-9d31-59ee601cc31f None None] MFA Rules not processed for user `24644cede7e149a6b3e5bd39b930017b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:16.501833 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-80a1e0a8-b975-48c9-9d31-59ee601cc31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:16.512449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 826/1665] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:40:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:16.523992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be2183-96ef-4779-9f86-c1503157f105 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:16.545438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be2183-96ef-4779-9f86-c1503157f105 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:16.571891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ca3a-cf65-415b-88e0-36b1339a4a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:16.573025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ca3a-cf65-415b-88e0-36b1339a4a1f service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:16.573354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ca3a-cf65-415b-88e0-36b1339a4a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:16.573638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ca3a-cf65-415b-88e0-36b1339a4a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:16.606433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ca3a-cf65-415b-88e0-36b1339a4a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:16.608029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ca3a-cf65-415b-88e0-36b1339a4a1f service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:16.636619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 840/1666] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:19.355117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee292e4-621e-4b30-9e00-df8bc49d029a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:19.356001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee292e4-621e-4b30-9e00-df8bc49d029a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:19.356321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee292e4-621e-4b30-9e00-df8bc49d029a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:19.597438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7ee292e4-621e-4b30-9e00-df8bc49d029a None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:19.598852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7ee292e4-621e-4b30-9e00-df8bc49d029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:19.749055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 827/1667] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:40:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:19.895488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ca3a-cf65-415b-88e0-36b1339a4a1f service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:20.064662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ca3a-cf65-415b-88e0-36b1339a4a1f service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:20.072666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:20.073797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:20.074113 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:20.074525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] PATH_INFO: `/v3/users/5f42e0111be048048bf3a0aa33e4ede9` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:20.079621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f42e0111be048048bf3a0aa33e4ede9)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:20.086352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:20.088702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee292e4-621e-4b30-9e00-df8bc49d029a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:20.090326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7ee292e4-621e-4b30-9e00-df8bc49d029a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:20.256297 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:20.272178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f42e0111be048048bf3a0aa33e4ede9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:20.319069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f42e0111be048048bf3a0aa33e4ede9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:20.329343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f42e0111be048048bf3a0aa33e4ede9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:20.330132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f42e0111be048048bf3a0aa33e4ede9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:20.330842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-93747488-51f1-4994-b315-9e603e75ba89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f42e0111be048048bf3a0aa33e4ede9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:20.360262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 841/1668] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:19 2022] DELETE /identity/v3/users/5f42e0111be048048bf3a0aa33e4ede9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:20.369115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a47f4c-c035-4bac-9f37-33db7f9deabb None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:20.369115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a47f4c-c035-4bac-9f37-33db7f9deabb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:20.375316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a47f4c-c035-4bac-9f37-33db7f9deabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:20.397860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee292e4-621e-4b30-9e00-df8bc49d029a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:20.444162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-93a47f4c-c035-4bac-9f37-33db7f9deabb None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:20.450658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93a47f4c-c035-4bac-9f37-33db7f9deabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:20.536316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:20.603313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 842/1669] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:20.629650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad035249-0ad6-4f65-856a-5fd4653ad2f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:20.630957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad035249-0ad6-4f65-856a-5fd4653ad2f4 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:20.631652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad035249-0ad6-4f65-856a-5fd4653ad2f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:20.632425 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad035249-0ad6-4f65-856a-5fd4653ad2f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:20.635228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ad035249-0ad6-4f65-856a-5fd4653ad2f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:20.729670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad035249-0ad6-4f65-856a-5fd4653ad2f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:20.732256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad035249-0ad6-4f65-856a-5fd4653ad2f4 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:20.742569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 828/1670] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:40:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:40:21.082676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a47f4c-c035-4bac-9f37-33db7f9deabb None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:21.084445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93a47f4c-c035-4bac-9f37-33db7f9deabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:21.279267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a47f4c-c035-4bac-9f37-33db7f9deabb None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:21.293533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366dded-71f9-480e-b519-745fde46eadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:21.296563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366dded-71f9-480e-b519-745fde46eadf service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:21.296845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366dded-71f9-480e-b519-745fde46eadf service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:21.297130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366dded-71f9-480e-b519-745fde46eadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:21.331117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366dded-71f9-480e-b519-745fde46eadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:21.332644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366dded-71f9-480e-b519-745fde46eadf service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:21.375684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 843/1671] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:22.228378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600c426-69c0-4e31-919f-9b1820906b47 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:22.229250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600c426-69c0-4e31-919f-9b1820906b47 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:22.229675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600c426-69c0-4e31-919f-9b1820906b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:22.292628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b600c426-69c0-4e31-919f-9b1820906b47 None None] MFA Rules not processed for user `24644cede7e149a6b3e5bd39b930017b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:22.296539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b600c426-69c0-4e31-919f-9b1820906b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:22.326469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366dded-71f9-480e-b519-745fde46eadf service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:22.327884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2366dded-71f9-480e-b519-745fde46eadf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:22.337771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 829/1672] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Aug 2 21:40:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:22.364681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366dded-71f9-480e-b519-745fde46eadf service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:22.410507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:22.416153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:22.420007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:22.422124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] PATH_INFO: `/v3/users/ec12182bfb3a43658b27aa984e3bffc6` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:22.424377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec12182bfb3a43658b27aa984e3bffc6)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:22.448858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:22.531805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600c426-69c0-4e31-919f-9b1820906b47 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:22.534648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b600c426-69c0-4e31-919f-9b1820906b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:22.561797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600c426-69c0-4e31-919f-9b1820906b47 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:22.582776 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4666e-4bf7-4ec3-812a-13b39e8d234b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:22.584906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4666e-4bf7-4ec3-812a-13b39e8d234b service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:22.585454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4666e-4bf7-4ec3-812a-13b39e8d234b service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:22.587533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4666e-4bf7-4ec3-812a-13b39e8d234b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:22.613889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4666e-4bf7-4ec3-812a-13b39e8d234b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:22.618663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4666e-4bf7-4ec3-812a-13b39e8d234b service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:22.647415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 830/1673] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:22.681345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec12182bfb3a43658b27aa984e3bffc6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:22.721908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:22.753781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec12182bfb3a43658b27aa984e3bffc6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:22.786022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec12182bfb3a43658b27aa984e3bffc6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:22.792501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec12182bfb3a43658b27aa984e3bffc6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:22.793971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec12182bfb3a43658b27aa984e3bffc6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:22.826664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 844/1674] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:22 2022] DELETE /identity/v3/users/ec12182bfb3a43658b27aa984e3bffc6 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:22.832041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8cd4a-a680-477e-8f9c-bfc3809863a3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:22.833066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8cd4a-a680-477e-8f9c-bfc3809863a3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:22.833888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8cd4a-a680-477e-8f9c-bfc3809863a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:22.901299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1ec8cd4a-a680-477e-8f9c-bfc3809863a3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:22.908051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1ec8cd4a-a680-477e-8f9c-bfc3809863a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:23.082971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 831/1675] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:23.146656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:23.149451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:23.331689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00aa3c-df5d-4ea1-bdb1-03f4738153de admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:23.351452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319ee1b-865e-4b07-bebd-b3199f4a7e7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:23.352599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319ee1b-865e-4b07-bebd-b3199f4a7e7f service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:23.353048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319ee1b-865e-4b07-bebd-b3199f4a7e7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:23.353581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319ee1b-865e-4b07-bebd-b3199f4a7e7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:23.372783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319ee1b-865e-4b07-bebd-b3199f4a7e7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:23.375069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319ee1b-865e-4b07-bebd-b3199f4a7e7f service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:23.391974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 845/1676] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:23.785486 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8cd4a-a680-477e-8f9c-bfc3809863a3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:23.788254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1ec8cd4a-a680-477e-8f9c-bfc3809863a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:23.813026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8cd4a-a680-477e-8f9c-bfc3809863a3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:23.826074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:23.826962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:23.827439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:23.827904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] PATH_INFO: `/v3/users/26bcecc660c54eb08f887dc9f6325a70` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:23.830548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bcecc660c54eb08f887dc9f6325a70)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:23.840944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: WARNING py.warnings [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:40:23.840944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: warnings.warn(msg) Aug 02 21:40:23.840944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: Aug 02 21:40:23.847627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:24.102859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bcecc660c54eb08f887dc9f6325a70'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:24.172022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bcecc660c54eb08f887dc9f6325a70'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:24.174049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:24.190729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bcecc660c54eb08f887dc9f6325a70'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:24.191345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bcecc660c54eb08f887dc9f6325a70'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:24.194018 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bcecc660c54eb08f887dc9f6325a70'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:24.280958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 832/1677] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:23 2022] DELETE /identity/v3/users/26bcecc660c54eb08f887dc9f6325a70 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:24.285442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3db4-7763-4042-9019-8ebde1f737d9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:24.285727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3db4-7763-4042-9019-8ebde1f737d9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:24.286049 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c3db4-7763-4042-9019-8ebde1f737d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:24.373663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ac0c3db4-7763-4042-9019-8ebde1f737d9 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:24.381884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ac0c3db4-7763-4042-9019-8ebde1f737d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:24.577002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 846/1678] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:24.620338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:24.620338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:24.808844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245a02b-0958-44ff-a06f-606f3687c00b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:24.817462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef9b798-54ef-488e-b4cc-5e20c56e52a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:24.818119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b798-54ef-488e-b4cc-5e20c56e52a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:24.818404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b798-54ef-488e-b4cc-5e20c56e52a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:24.818680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b798-54ef-488e-b4cc-5e20c56e52a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:24.847859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9b798-54ef-488e-b4cc-5e20c56e52a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:24.849373 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef9b798-54ef-488e-b4cc-5e20c56e52a5 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:24.880046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 833/1679] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:25.117810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c3db4-7763-4042-9019-8ebde1f737d9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:25.120019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ac0c3db4-7763-4042-9019-8ebde1f737d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:25.147007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c3db4-7763-4042-9019-8ebde1f737d9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:25.160966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:25.162925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:25.162925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:25.163102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] PATH_INFO: `/v3/projects/3028ae6ba7df458080081ede634e4102` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:25.170404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3028ae6ba7df458080081ede634e4102)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:25.173658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: WARNING py.warnings [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:40:25.173658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: warnings.warn(msg) Aug 02 21:40:25.173658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: Aug 02 21:40:25.175097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:25.340905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3028ae6ba7df458080081ede634e4102', 'request_id': 'req-d617f500-6ac9-462d-92b0-c7bedc009918'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:25.396285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3028ae6ba7df458080081ede634e4102', 'request_id': 'req-d617f500-6ac9-462d-92b0-c7bedc009918'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:25.428581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3028ae6ba7df458080081ede634e4102', 'request_id': 'req-d617f500-6ac9-462d-92b0-c7bedc009918'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:25.467602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] The token cache is being invalidate because project 3028ae6ba7df458080081ede634e4102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:25.468102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:25.469117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d617f500-6ac9-462d-92b0-c7bedc009918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:25.471933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 847/1680] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:25 2022] DELETE /identity/v3/projects/3028ae6ba7df458080081ede634e4102 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:25.484979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ee541-4e69-4053-a29f-2c8b2c7e9acc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:25.485274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ee541-4e69-4053-a29f-2c8b2c7e9acc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:25.485610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ee541-4e69-4053-a29f-2c8b2c7e9acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:25.527176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b70ee541-4e69-4053-a29f-2c8b2c7e9acc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:25.532851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b70ee541-4e69-4053-a29f-2c8b2c7e9acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:25.719440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 834/1681] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:25.721284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0e3a1-8539-410a-9604-bcb6166c774b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:25.721860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0e3a1-8539-410a-9604-bcb6166c774b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:25.722294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0e3a1-8539-410a-9604-bcb6166c774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:25.737032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:25.771840 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4cb0e3a1-8539-410a-9604-bcb6166c774b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:25.777938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4cb0e3a1-8539-410a-9604-bcb6166c774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:25.807842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 848/1682] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:25.819017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ee541-4e69-4053-a29f-2c8b2c7e9acc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:25.837694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ee541-4e69-4053-a29f-2c8b2c7e9acc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:25.855351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd8df6-56fa-4ce9-a232-5425e315d6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:25.855351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd8df6-56fa-4ce9-a232-5425e315d6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:25.855351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd8df6-56fa-4ce9-a232-5425e315d6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:25.855351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd8df6-56fa-4ce9-a232-5425e315d6b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:25.858033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd8df6-56fa-4ce9-a232-5425e315d6b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:25.863995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd8df6-56fa-4ce9-a232-5425e315d6b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:25.868265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd8df6-56fa-4ce9-a232-5425e315d6b7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:25.905988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 835/1683] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:25.907214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0e3a1-8539-410a-9604-bcb6166c774b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:25.927910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0e3a1-8539-410a-9604-bcb6166c774b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:25.942342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcd957-99b9-4d4f-bad3-9dd001000f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:25.944362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcd957-99b9-4d4f-bad3-9dd001000f26 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:25.945587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcd957-99b9-4d4f-bad3-9dd001000f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:25.946577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fcd957-99b9-4d4f-bad3-9dd001000f26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:25.947701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcd957-99b9-4d4f-bad3-9dd001000f26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:25.953854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fcd957-99b9-4d4f-bad3-9dd001000f26 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:26.016454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 849/1684] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:25 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:26.021288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd8df6-56fa-4ce9-a232-5425e315d6b7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:26.044902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd8df6-56fa-4ce9-a232-5425e315d6b7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:26.214248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcd957-99b9-4d4f-bad3-9dd001000f26 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:26.224325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c6fcd957-99b9-4d4f-bad3-9dd001000f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:26.235189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcc81a-40eb-41f6-8b1d-e8931a4572cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:26.235189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcc81a-40eb-41f6-8b1d-e8931a4572cb admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:26.235189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcc81a-40eb-41f6-8b1d-e8931a4572cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:26.235189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdcc81a-40eb-41f6-8b1d-e8931a4572cb admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:26.236384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcc81a-40eb-41f6-8b1d-e8931a4572cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:26.237977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdcc81a-40eb-41f6-8b1d-e8931a4572cb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:26.269854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:26.277690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fcd957-99b9-4d4f-bad3-9dd001000f26 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:26.292276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:26.293286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:26.293920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:26.294769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 836/1685] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:26 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:26.295531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] PATH_INFO: `/v3/projects/06586f2fd2b54a30b14582919e042b90` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:26.297672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06586f2fd2b54a30b14582919e042b90)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:26.298449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcc81a-40eb-41f6-8b1d-e8931a4572cb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:26.301774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:26.313888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdcc81a-40eb-41f6-8b1d-e8931a4572cb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:26.327933 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea9b2c-7b38-4127-9524-a53bdddee016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:26.328615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea9b2c-7b38-4127-9524-a53bdddee016 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:26.328893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea9b2c-7b38-4127-9524-a53bdddee016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:26.329159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea9b2c-7b38-4127-9524-a53bdddee016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:26.329864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea9b2c-7b38-4127-9524-a53bdddee016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:26.331480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ea9b2c-7b38-4127-9524-a53bdddee016 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:26.355592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 837/1686] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:26.359595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea9b2c-7b38-4127-9524-a53bdddee016 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:26.378312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea9b2c-7b38-4127-9524-a53bdddee016 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:26.389714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028b068-ee93-477f-952a-625467a21795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:26.390375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028b068-ee93-477f-952a-625467a21795 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:26.390619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028b068-ee93-477f-952a-625467a21795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:26.390893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2028b068-ee93-477f-952a-625467a21795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:26.392607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028b068-ee93-477f-952a-625467a21795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:26.393253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2028b068-ee93-477f-952a-625467a21795 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:26.418310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 838/1687] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:26 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:26.428102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028b068-ee93-477f-952a-625467a21795 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:26.446836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2028b068-ee93-477f-952a-625467a21795 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:26.460988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06586f2fd2b54a30b14582919e042b90', 'request_id': 'req-e45720b4-6655-4f22-a8e5-5483ad1d44f6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:26.471617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06586f2fd2b54a30b14582919e042b90', 'request_id': 'req-e45720b4-6655-4f22-a8e5-5483ad1d44f6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:26.484539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06586f2fd2b54a30b14582919e042b90', 'request_id': 'req-e45720b4-6655-4f22-a8e5-5483ad1d44f6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:26.533334 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] The token cache is being invalidate because project 06586f2fd2b54a30b14582919e042b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:26.534291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:26.535773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e45720b4-6655-4f22-a8e5-5483ad1d44f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:26.537997 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 850/1688] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:26 2022] DELETE /identity/v3/projects/06586f2fd2b54a30b14582919e042b90 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:26.546112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a6588-3ce7-4ba7-8b07-3417ec7b9a32 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:26.547458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a6588-3ce7-4ba7-8b07-3417ec7b9a32 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:26.549228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a6588-3ce7-4ba7-8b07-3417ec7b9a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:26.605546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5d9a6588-3ce7-4ba7-8b07-3417ec7b9a32 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:26.609404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5d9a6588-3ce7-4ba7-8b07-3417ec7b9a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:26.618507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c000ce-997a-4402-a810-bdb4b8b42312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:26.619439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c000ce-997a-4402-a810-bdb4b8b42312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:26.622332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c000ce-997a-4402-a810-bdb4b8b42312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:26.622702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c000ce-997a-4402-a810-bdb4b8b42312 admin admin] PATH_INFO: `/v3/projects/3c76ac335d9c4ba4b9f7f1ba8ad34a7e/users/6e2a72bc32a848da96006efbfa8a8685/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:26.700183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c000ce-997a-4402-a810-bdb4b8b42312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c76ac335d9c4ba4b9f7f1ba8ad34a7e, user_id=6e2a72bc32a848da96006efbfa8a8685, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:26.709620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c000ce-997a-4402-a810-bdb4b8b42312 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:26.717577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 851/1689] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:26.719622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a2a14-0241-4107-b6b3-f39719134fd9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:26.720122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a2a14-0241-4107-b6b3-f39719134fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:26.721114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a2a14-0241-4107-b6b3-f39719134fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:26.753686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ff4a2a14-0241-4107-b6b3-f39719134fd9 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:26.753884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 839/1690] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:26 2022] PUT /identity/v3/projects/3c76ac335d9c4ba4b9f7f1ba8ad34a7e/users/6e2a72bc32a848da96006efbfa8a8685/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:26.755719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ff4a2a14-0241-4107-b6b3-f39719134fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:26.770234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8a6d2-4276-4d10-ba90-89df75bb935e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:26.770531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8a6d2-4276-4d10-ba90-89df75bb935e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:26.770811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8a6d2-4276-4d10-ba90-89df75bb935e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:26.861733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6df8a6d2-4276-4d10-ba90-89df75bb935e None None] MFA Rules not processed for user `6e2a72bc32a848da96006efbfa8a8685`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:26.866032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6df8a6d2-4276-4d10-ba90-89df75bb935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:26.977962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:27.029054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 852/1691] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:27.030054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a2a14-0241-4107-b6b3-f39719134fd9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:27.072310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a2a14-0241-4107-b6b3-f39719134fd9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:27.088930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109be517-eb5c-4049-81b0-8092aaadcbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:27.090325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109be517-eb5c-4049-81b0-8092aaadcbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:27.092656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109be517-eb5c-4049-81b0-8092aaadcbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:27.093183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109be517-eb5c-4049-81b0-8092aaadcbe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:27.095635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109be517-eb5c-4049-81b0-8092aaadcbe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:27.095941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109be517-eb5c-4049-81b0-8092aaadcbe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:27.100187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109be517-eb5c-4049-81b0-8092aaadcbe0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:27.156389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 853/1692] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:27.160555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109be517-eb5c-4049-81b0-8092aaadcbe0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:27.203817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109be517-eb5c-4049-81b0-8092aaadcbe0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:27.212929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f924901-817d-4fc5-b058-78ebabe33949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:27.214844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f924901-817d-4fc5-b058-78ebabe33949 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:27.215202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f924901-817d-4fc5-b058-78ebabe33949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:27.215621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f924901-817d-4fc5-b058-78ebabe33949 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:27.219088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 840/1693] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:27.224486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f924901-817d-4fc5-b058-78ebabe33949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:27.227633 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8a6d2-4276-4d10-ba90-89df75bb935e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:27.227843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f924901-817d-4fc5-b058-78ebabe33949 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:27.233662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6df8a6d2-4276-4d10-ba90-89df75bb935e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:27.301269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 854/1694] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:27 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:27.304926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f924901-817d-4fc5-b058-78ebabe33949 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:27.315644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8a6d2-4276-4d10-ba90-89df75bb935e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:27.439060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:27.473021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a3042-9cc8-4ac8-9340-01ebb565915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:27.474556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a3042-9cc8-4ac8-9340-01ebb565915f admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:27.476558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a3042-9cc8-4ac8-9340-01ebb565915f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:27.476996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a3042-9cc8-4ac8-9340-01ebb565915f admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:27.478593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a3042-9cc8-4ac8-9340-01ebb565915f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:27.483047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9a3042-9cc8-4ac8-9340-01ebb565915f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:27.559681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 841/1695] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:27 2022] POST /identity/v3/projects => generated 371 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:27.564299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a3042-9cc8-4ac8-9340-01ebb565915f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:27.654710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f924901-817d-4fc5-b058-78ebabe33949 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:27.840121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76f06-2c2d-44c4-82e3-82a0325571ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:27.841273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76f06-2c2d-44c4-82e3-82a0325571ec admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:27.841878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76f06-2c2d-44c4-82e3-82a0325571ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:27.842770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d76f06-2c2d-44c4-82e3-82a0325571ec admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:27.843969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76f06-2c2d-44c4-82e3-82a0325571ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:27.846685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d76f06-2c2d-44c4-82e3-82a0325571ec admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:27.869289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a3042-9cc8-4ac8-9340-01ebb565915f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:27.895838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 855/1696] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:27 2022] POST /identity/v3/users => generated 292 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:27.897883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76f06-2c2d-44c4-82e3-82a0325571ec admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:27.899421 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289fc8d-2bb9-4ba2-8041-4c25ec4ce217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:27.900278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289fc8d-2bb9-4ba2-8041-4c25ec4ce217 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:27.902918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289fc8d-2bb9-4ba2-8041-4c25ec4ce217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:27.903419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289fc8d-2bb9-4ba2-8041-4c25ec4ce217 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:27.905355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289fc8d-2bb9-4ba2-8041-4c25ec4ce217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:27.922503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289fc8d-2bb9-4ba2-8041-4c25ec4ce217 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:27.926121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d76f06-2c2d-44c4-82e3-82a0325571ec admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:27.940109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f9192-0106-4a59-85c0-3f4c3fab536e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:27.940901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9192-0106-4a59-85c0-3f4c3fab536e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:27.941899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9192-0106-4a59-85c0-3f4c3fab536e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:27.942295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f9192-0106-4a59-85c0-3f4c3fab536e admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:27.945900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f9192-0106-4a59-85c0-3f4c3fab536e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:27.951633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976f9192-0106-4a59-85c0-3f4c3fab536e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:27.984383 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 856/1697] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:27.986128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f9192-0106-4a59-85c0-3f4c3fab536e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:28.010179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f9192-0106-4a59-85c0-3f4c3fab536e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:28.025966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13242907-cc16-4690-969f-9bb9fe210e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:28.026686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13242907-cc16-4690-969f-9bb9fe210e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.027120 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13242907-cc16-4690-969f-9bb9fe210e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.028328 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 842/1698] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:27 2022] POST /identity/v3/users => generated 292 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:28.030688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289fc8d-2bb9-4ba2-8041-4c25ec4ce217 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:28.038919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13242907-cc16-4690-969f-9bb9fe210e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.041581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13242907-cc16-4690-969f-9bb9fe210e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:28.043390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13242907-cc16-4690-969f-9bb9fe210e7b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:28.061544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289fc8d-2bb9-4ba2-8041-4c25ec4ce217 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:28.075181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa534a-b070-42fb-9473-14cc0df59a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:28.077355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa534a-b070-42fb-9473-14cc0df59a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.078697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa534a-b070-42fb-9473-14cc0df59a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.079240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa534a-b070-42fb-9473-14cc0df59a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.081342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa534a-b070-42fb-9473-14cc0df59a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:28.085847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa534a-b070-42fb-9473-14cc0df59a2b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:28.091042 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 857/1699] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:28.094883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13242907-cc16-4690-969f-9bb9fe210e7b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:28.123642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13242907-cc16-4690-969f-9bb9fe210e7b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:28.128065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 843/1700] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:28.129015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa534a-b070-42fb-9473-14cc0df59a2b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:28.131793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4531fe9-3af2-48e2-8855-0c0a37f4364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:28.133543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531fe9-3af2-48e2-8855-0c0a37f4364d admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.134086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531fe9-3af2-48e2-8855-0c0a37f4364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.134573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531fe9-3af2-48e2-8855-0c0a37f4364d admin admin] PATH_INFO: `/v3/projects/2ad579f213984b3fb8281530d46fcc99/users/76e1a26fdb34482a9ce11a08698e0907/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.161779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4531fe9-3af2-48e2-8855-0c0a37f4364d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ad579f213984b3fb8281530d46fcc99, user_id=76e1a26fdb34482a9ce11a08698e0907, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:28.165656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4531fe9-3af2-48e2-8855-0c0a37f4364d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:28.165902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa534a-b070-42fb-9473-14cc0df59a2b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:28.181488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b422-8fda-431b-a2e6-ccb638b4e221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:28.182529 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b422-8fda-431b-a2e6-ccb638b4e221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.182999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b422-8fda-431b-a2e6-ccb638b4e221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.183839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8b422-8fda-431b-a2e6-ccb638b4e221 admin admin] PATH_INFO: `/v3/projects/1536dd9d938246629381a424b66b66c2/users/5cd0f68ac7774e5db11bae153d716f7f/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.215038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 858/1701] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:28 2022] PUT /identity/v3/projects/2ad579f213984b3fb8281530d46fcc99/users/76e1a26fdb34482a9ce11a08698e0907/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:28.217202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987d26a-577e-4500-9b81-feb1bc555f18 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.217730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987d26a-577e-4500-9b81-feb1bc555f18 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.218989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987d26a-577e-4500-9b81-feb1bc555f18 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.221690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 859/1702] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:40:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:40:28.226986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a159d-baa3-4daf-b952-e271babe0a0a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.227395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a159d-baa3-4daf-b952-e271babe0a0a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.227530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a159d-baa3-4daf-b952-e271babe0a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.240933 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8b422-8fda-431b-a2e6-ccb638b4e221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1536dd9d938246629381a424b66b66c2, user_id=5cd0f68ac7774e5db11bae153d716f7f, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:28.251559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8b422-8fda-431b-a2e6-ccb638b4e221 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:28.287016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 844/1703] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:28 2022] PUT /identity/v3/projects/1536dd9d938246629381a424b66b66c2/users/5cd0f68ac7774e5db11bae153d716f7f/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:28.287218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:28.288897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b422-8fda-431b-a2e6-ccb638b4e221 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:28.298727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-fc2a159d-baa3-4daf-b952-e271babe0a0a None None] MFA Rules not processed for user `76e1a26fdb34482a9ce11a08698e0907`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:28.304681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fc2a159d-baa3-4daf-b952-e271babe0a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:28.523932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8b422-8fda-431b-a2e6-ccb638b4e221 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:28.524165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 860/1704] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:28.533033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03e164-7a43-4404-892d-b2702db85c95 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.533033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03e164-7a43-4404-892d-b2702db85c95 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.533033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03e164-7a43-4404-892d-b2702db85c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.537378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ab53a-d8aa-455d-8188-2b410f91e9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:28.538317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ab53a-d8aa-455d-8188-2b410f91e9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.538846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ab53a-d8aa-455d-8188-2b410f91e9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.539296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ab53a-d8aa-455d-8188-2b410f91e9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.540657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ab53a-d8aa-455d-8188-2b410f91e9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:28.544016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ab53a-d8aa-455d-8188-2b410f91e9bd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:28.567608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 845/1705] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:28 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:28.568701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ab53a-d8aa-455d-8188-2b410f91e9bd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:28.577917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4e03e164-7a43-4404-892d-b2702db85c95 None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:28.580463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4e03e164-7a43-4404-892d-b2702db85c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:28.612772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ab53a-d8aa-455d-8188-2b410f91e9bd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:28.630334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0a5a5-0d5e-4fe1-b696-5ec635545c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:28.631127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0a5a5-0d5e-4fe1-b696-5ec635545c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.631702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0a5a5-0d5e-4fe1-b696-5ec635545c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.632293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce0a5a5-0d5e-4fe1-b696-5ec635545c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.633179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0a5a5-0d5e-4fe1-b696-5ec635545c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:28.636390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce0a5a5-0d5e-4fe1-b696-5ec635545c2a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:28.699771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:28.722307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 846/1706] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:28 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:28.723594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0a5a5-0d5e-4fe1-b696-5ec635545c2a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:28.810528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 861/1707] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:40:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:28.811787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03e164-7a43-4404-892d-b2702db85c95 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:28.866453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03e164-7a43-4404-892d-b2702db85c95 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:28.935345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce0a5a5-0d5e-4fe1-b696-5ec635545c2a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:28.961877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a3fe97-ad54-4a21-9a11-dcb3ddb07c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:28.963631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3fe97-ad54-4a21-9a11-dcb3ddb07c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:28.965803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3fe97-ad54-4a21-9a11-dcb3ddb07c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:28.966394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3fe97-ad54-4a21-9a11-dcb3ddb07c36 admin admin] PATH_INFO: `/v3/projects/1536dd9d938246629381a424b66b66c2/users/5cd0f68ac7774e5db11bae153d716f7f/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:28.983532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3fe97-ad54-4a21-9a11-dcb3ddb07c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1536dd9d938246629381a424b66b66c2, user_id=5cd0f68ac7774e5db11bae153d716f7f, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:28.992451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a3fe97-ad54-4a21-9a11-dcb3ddb07c36 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:29.033170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851a3df-4137-4072-96c9-19bca489b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:29.034196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851a3df-4137-4072-96c9-19bca489b02f admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:29.034489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851a3df-4137-4072-96c9-19bca489b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:29.034749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a851a3df-4137-4072-96c9-19bca489b02f admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:29.035431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851a3df-4137-4072-96c9-19bca489b02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:29.037428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a851a3df-4137-4072-96c9-19bca489b02f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:29.038178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 847/1708] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:28 2022] PUT /identity/v3/projects/1536dd9d938246629381a424b66b66c2/users/5cd0f68ac7774e5db11bae153d716f7f/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:29.050581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92145-e42a-45d7-89f9-b97926a37b8b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:29.051185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92145-e42a-45d7-89f9-b97926a37b8b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:29.051763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d92145-e42a-45d7-89f9-b97926a37b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:29.097269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 862/1709] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:28 2022] POST /identity/v3/users => generated 298 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:29.098510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851a3df-4137-4072-96c9-19bca489b02f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:29.121882 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a851a3df-4137-4072-96c9-19bca489b02f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:29.132595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c6d92145-e42a-45d7-89f9-b97926a37b8b None None] MFA Rules not processed for user `5cd0f68ac7774e5db11bae153d716f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:29.135967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c6d92145-e42a-45d7-89f9-b97926a37b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:29.174062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:29.267244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d284b-1e84-4be5-9814-1351df2696ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:29.271951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d284b-1e84-4be5-9814-1351df2696ca admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:29.272339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d284b-1e84-4be5-9814-1351df2696ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:29.272779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d284b-1e84-4be5-9814-1351df2696ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:29.274920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d284b-1e84-4be5-9814-1351df2696ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:29.278930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d284b-1e84-4be5-9814-1351df2696ca admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:29.305650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 863/1710] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:29.313096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d284b-1e84-4be5-9814-1351df2696ca admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:29.340742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d284b-1e84-4be5-9814-1351df2696ca admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:29.357572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49249570-9443-49cb-8b7a-745e43ba4404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:29.359081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49249570-9443-49cb-8b7a-745e43ba4404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:29.359363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49249570-9443-49cb-8b7a-745e43ba4404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:29.359640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49249570-9443-49cb-8b7a-745e43ba4404 admin admin] PATH_INFO: `/v3/projects/845f52d614c341d3aa4684e2c45e284d/users/108d633f32b64f2a9498c0628969cce9/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:29.377092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 848/1711] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:29.389801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d92145-e42a-45d7-89f9-b97926a37b8b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:29.391674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c6d92145-e42a-45d7-89f9-b97926a37b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:29.419431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49249570-9443-49cb-8b7a-745e43ba4404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=845f52d614c341d3aa4684e2c45e284d, user_id=108d633f32b64f2a9498c0628969cce9, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:29.426072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49249570-9443-49cb-8b7a-745e43ba4404 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:29.454308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 864/1712] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:29 2022] PUT /identity/v3/projects/845f52d614c341d3aa4684e2c45e284d/users/108d633f32b64f2a9498c0628969cce9/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:29.459481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49249570-9443-49cb-8b7a-745e43ba4404 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:29.503324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d92145-e42a-45d7-89f9-b97926a37b8b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:29.551533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:29.603863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5e420-2960-4188-93f8-42d40a2b1147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:29.604994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5e420-2960-4188-93f8-42d40a2b1147 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:29.604994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5e420-2960-4188-93f8-42d40a2b1147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:29.605557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5e420-2960-4188-93f8-42d40a2b1147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:29.608377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49249570-9443-49cb-8b7a-745e43ba4404 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:29.615906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ea0f-b2f5-44a8-a95f-dc1aca5bbca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:29.617190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ea0f-b2f5-44a8-a95f-dc1aca5bbca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:29.617470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ea0f-b2f5-44a8-a95f-dc1aca5bbca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:29.617811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690ea0f-b2f5-44a8-a95f-dc1aca5bbca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:29.618589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690ea0f-b2f5-44a8-a95f-dc1aca5bbca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:29.623073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690ea0f-b2f5-44a8-a95f-dc1aca5bbca3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:29.646648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 865/1713] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:29.649341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ea0f-b2f5-44a8-a95f-dc1aca5bbca3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:29.674277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690ea0f-b2f5-44a8-a95f-dc1aca5bbca3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:29.684849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e35fc-e4ea-4710-bd2f-eef01fd2035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:29.684849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e35fc-e4ea-4710-bd2f-eef01fd2035b admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:29.684849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e35fc-e4ea-4710-bd2f-eef01fd2035b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:29.684849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e35fc-e4ea-4710-bd2f-eef01fd2035b admin admin] PATH_INFO: `/v3/projects/845f52d614c341d3aa4684e2c45e284d/users/108d633f32b64f2a9498c0628969cce9/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:29.687923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e35fc-e4ea-4710-bd2f-eef01fd2035b admin admin] RBAC: Authorizing `identity:create_grant(project_id=845f52d614c341d3aa4684e2c45e284d, user_id=108d633f32b64f2a9498c0628969cce9, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:29.695861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e35fc-e4ea-4710-bd2f-eef01fd2035b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:29.726859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 866/1714] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:29 2022] PUT /identity/v3/projects/845f52d614c341d3aa4684e2c45e284d/users/108d633f32b64f2a9498c0628969cce9/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:29.737566 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c8ae6-3e56-4bb9-bb4f-2dfa139f52ef None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:29.737848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c8ae6-3e56-4bb9-bb4f-2dfa139f52ef None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:29.738127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c8ae6-3e56-4bb9-bb4f-2dfa139f52ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:29.791373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9b6c8ae6-3e56-4bb9-bb4f-2dfa139f52ef None None] MFA Rules not processed for user `108d633f32b64f2a9498c0628969cce9`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:29.791604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5e420-2960-4188-93f8-42d40a2b1147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:29.792684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9b6c8ae6-3e56-4bb9-bb4f-2dfa139f52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:29.793471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5e420-2960-4188-93f8-42d40a2b1147 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:29.824474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 849/1715] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:29.825955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5e420-2960-4188-93f8-42d40a2b1147 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:29.827449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-45a5e420-2960-4188-93f8-42d40a2b1147 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:29.846413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5e420-2960-4188-93f8-42d40a2b1147 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:30.033921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:30.034584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 867/1716] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:30.035102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:30.035213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c8ae6-3e56-4bb9-bb4f-2dfa139f52ef None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:30.035296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:30.035296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] PATH_INFO: `/v3/projects/a9f108fadc514e90a02244bde8fcb3ec` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:30.035296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f108fadc514e90a02244bde8fcb3ec)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:30.035510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9b6c8ae6-3e56-4bb9-bb4f-2dfa139f52ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:30.039042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:30.049072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:30.151272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f108fadc514e90a02244bde8fcb3ec', 'request_id': 'req-63399234-1a17-411e-ae7b-febdafebdff1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.161228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f108fadc514e90a02244bde8fcb3ec', 'request_id': 'req-63399234-1a17-411e-ae7b-febdafebdff1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.174841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f108fadc514e90a02244bde8fcb3ec', 'request_id': 'req-63399234-1a17-411e-ae7b-febdafebdff1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.189852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] The token cache is being invalidate because project a9f108fadc514e90a02244bde8fcb3ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:30.190105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.190799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.197397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 850/1717] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:29 2022] DELETE /identity/v3/projects/a9f108fadc514e90a02244bde8fcb3ec => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:30.198723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:30.207591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c8ae6-3e56-4bb9-bb4f-2dfa139f52ef None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:30.212949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:30.289406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:30.441051 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:30.441701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:30.442029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:30.442249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:30.446983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63399234-1a17-411e-ae7b-febdafebdff1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:30.447194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:30.467435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:30.471864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:30.475132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:30.476393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:30.483300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:30.484975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:30.487103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:30.518260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 868/1718] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:30.519350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:30.531905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:30.663725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c40db8-d88d-4a97-bc87-364366f57081 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:30.681565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:30.682233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:30.682515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:30.682944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] PATH_INFO: `/v3/users/4dec05fbd5fc49d8a1cc9c82221ca178` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:30.684352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dec05fbd5fc49d8a1cc9c82221ca178)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:30.690482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:30.703953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:30.705827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:30.738376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 851/1719] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:30.769315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:30.846471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dec05fbd5fc49d8a1cc9c82221ca178'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.906097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dec05fbd5fc49d8a1cc9c82221ca178'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.909667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:30.911238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:30.926311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dec05fbd5fc49d8a1cc9c82221ca178'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.927145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dec05fbd5fc49d8a1cc9c82221ca178'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.928075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dec05fbd5fc49d8a1cc9c82221ca178'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:30.959892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 869/1720] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:30 2022] DELETE /identity/v3/users/4dec05fbd5fc49d8a1cc9c82221ca178 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:30.960647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c32e25-7728-403e-9237-5dd7b292cfa3 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:31.027613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:31.029636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:31.147262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40190d-431f-48a5-bf73-c257650a3ece admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:31.148546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:31.148546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:31.149060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:31.149060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] PATH_INFO: `/v3/users/6e2a72bc32a848da96006efbfa8a8685` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:31.150348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e2a72bc32a848da96006efbfa8a8685)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:31.152650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:31.154108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915616a-8def-4169-8bdf-e556165ca1de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:31.155237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915616a-8def-4169-8bdf-e556165ca1de service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:31.183158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915616a-8def-4169-8bdf-e556165ca1de service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:31.185231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915616a-8def-4169-8bdf-e556165ca1de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:31.192287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e915616a-8def-4169-8bdf-e556165ca1de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:31.258023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e2a72bc32a848da96006efbfa8a8685'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:31.273301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e2a72bc32a848da96006efbfa8a8685'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:31.290723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e2a72bc32a848da96006efbfa8a8685'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:31.291460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e2a72bc32a848da96006efbfa8a8685'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:31.292265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ef8c9835-c303-4454-bd11-d30396f40ed5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e2a72bc32a848da96006efbfa8a8685'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:31.295754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:31.334030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 852/1721] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:30 2022] DELETE /identity/v3/users/6e2a72bc32a848da96006efbfa8a8685 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:31.334817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30431fe7-5e08-4668-9388-8757d8666f81 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:31.336878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30431fe7-5e08-4668-9388-8757d8666f81 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:31.337170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30431fe7-5e08-4668-9388-8757d8666f81 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:31.338552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 853/1722] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:40:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:40:31.342520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6e240-9b67-4738-bb64-7413aa250f64 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:31.343705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6e240-9b67-4738-bb64-7413aa250f64 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:31.343990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6e240-9b67-4738-bb64-7413aa250f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:31.382718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915616a-8def-4169-8bdf-e556165ca1de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:31.384859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915616a-8def-4169-8bdf-e556165ca1de service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:31.403067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-33a6e240-9b67-4738-bb64-7413aa250f64 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:31.407878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 870/1723] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:31.408102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-33a6e240-9b67-4738-bb64-7413aa250f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:31.511103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 854/1724] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:31.542856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e4f85-68f4-4c32-8664-7885ef917620 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:31.543201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e4f85-68f4-4c32-8664-7885ef917620 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:31.543547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e4f85-68f4-4c32-8664-7885ef917620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:31.553176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6e240-9b67-4738-bb64-7413aa250f64 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:31.555289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-33a6e240-9b67-4738-bb64-7413aa250f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:31.614995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2c0e4f85-68f4-4c32-8664-7885ef917620 None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:31.616320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2c0e4f85-68f4-4c32-8664-7885ef917620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:31.760270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6e240-9b67-4738-bb64-7413aa250f64 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:31.780294 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35479ef7-44a7-4cd2-9899-b783c118ca38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:31.780938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35479ef7-44a7-4cd2-9899-b783c118ca38 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:31.781228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35479ef7-44a7-4cd2-9899-b783c118ca38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:31.781508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35479ef7-44a7-4cd2-9899-b783c118ca38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:31.829587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35479ef7-44a7-4cd2-9899-b783c118ca38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:31.831304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35479ef7-44a7-4cd2-9899-b783c118ca38 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:31.839716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:31.866351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 855/1725] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:31.882380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 871/1726] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:40:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:32.429822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35479ef7-44a7-4cd2-9899-b783c118ca38 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:32.431788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-35479ef7-44a7-4cd2-9899-b783c118ca38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:32.459522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35479ef7-44a7-4cd2-9899-b783c118ca38 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:32.467728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27285f01-d3cf-4d21-9aa9-135762b6c110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:32.468688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27285f01-d3cf-4d21-9aa9-135762b6c110 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:32.469642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27285f01-d3cf-4d21-9aa9-135762b6c110 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:32.470031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27285f01-d3cf-4d21-9aa9-135762b6c110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:32.484085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27285f01-d3cf-4d21-9aa9-135762b6c110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:32.486179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27285f01-d3cf-4d21-9aa9-135762b6c110 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:32.502906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 856/1727] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:33.244012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e4f85-68f4-4c32-8664-7885ef917620 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:33.245561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2c0e4f85-68f4-4c32-8664-7885ef917620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:33.280019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e4f85-68f4-4c32-8664-7885ef917620 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:33.293339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:33.294252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:33.294703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:33.295146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] PATH_INFO: `/v3/projects/3c76ac335d9c4ba4b9f7f1ba8ad34a7e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:33.296976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c76ac335d9c4ba4b9f7f1ba8ad34a7e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:33.299998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:33.339191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27285f01-d3cf-4d21-9aa9-135762b6c110 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:33.341580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-27285f01-d3cf-4d21-9aa9-135762b6c110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:33.363277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27285f01-d3cf-4d21-9aa9-135762b6c110 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:33.375879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c76ac335d9c4ba4b9f7f1ba8ad34a7e', 'request_id': 'req-3b5b640e-99af-436b-80e5-cbac44dd00cb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.384941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c76ac335d9c4ba4b9f7f1ba8ad34a7e', 'request_id': 'req-3b5b640e-99af-436b-80e5-cbac44dd00cb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.399933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c76ac335d9c4ba4b9f7f1ba8ad34a7e', 'request_id': 'req-3b5b640e-99af-436b-80e5-cbac44dd00cb'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.416651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] The token cache is being invalidate because project 3c76ac335d9c4ba4b9f7f1ba8ad34a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:33.416963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.418165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.420421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 872/1728] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:33 2022] DELETE /identity/v3/projects/3c76ac335d9c4ba4b9f7f1ba8ad34a7e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:33.424393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:33.435938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:33.453182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:33.453841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:33.454121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:33.454829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] PATH_INFO: `/v3/projects/54d7a88d022b4bc0a871e893f3193772` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:33.457864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d7a88d022b4bc0a871e893f3193772)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:33.462347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:33.482372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:33.519418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b640e-99af-436b-80e5-cbac44dd00cb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:33.533288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d7a88d022b4bc0a871e893f3193772', 'request_id': 'req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.542994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d7a88d022b4bc0a871e893f3193772', 'request_id': 'req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.554579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d7a88d022b4bc0a871e893f3193772', 'request_id': 'req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.568315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] The token cache is being invalidate because project 54d7a88d022b4bc0a871e893f3193772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:33.568918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.569931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ad635dc2-28ae-4af8-8b52-b1bd1c57a35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.572504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 857/1729] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:33 2022] DELETE /identity/v3/projects/54d7a88d022b4bc0a871e893f3193772 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:33.578061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d399f-d9e0-4818-b344-a6a491fbad4a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:33.578638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d399f-d9e0-4818-b344-a6a491fbad4a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:33.579129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d399f-d9e0-4818-b344-a6a491fbad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:33.601897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:33.601897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:33.601897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:33.602244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] PATH_INFO: `/v3/users/5cd0f68ac7774e5db11bae153d716f7f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:33.603563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd0f68ac7774e5db11bae153d716f7f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:33.606211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:33.608349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0e1d399f-d9e0-4818-b344-a6a491fbad4a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:33.610867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0e1d399f-d9e0-4818-b344-a6a491fbad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:33.622601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 858/1730] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:33.630973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21144812-c625-4e48-9c5b-f6ac424f9e6f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:33.631277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21144812-c625-4e48-9c5b-f6ac424f9e6f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:33.631637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21144812-c625-4e48-9c5b-f6ac424f9e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:33.661275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:33.668768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-21144812-c625-4e48-9c5b-f6ac424f9e6f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:33.670174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-21144812-c625-4e48-9c5b-f6ac424f9e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:33.680372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 859/1731] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:33.684877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21144812-c625-4e48-9c5b-f6ac424f9e6f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:33.695784 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd0f68ac7774e5db11bae153d716f7f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.696168 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21144812-c625-4e48-9c5b-f6ac424f9e6f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:33.701026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23373402-0247-4db0-822d-72164d27f91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:33.701645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23373402-0247-4db0-822d-72164d27f91b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:33.701930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23373402-0247-4db0-822d-72164d27f91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:33.702202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23373402-0247-4db0-822d-72164d27f91b admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:33.702903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23373402-0247-4db0-822d-72164d27f91b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:33.703215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23373402-0247-4db0-822d-72164d27f91b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:33.704852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23373402-0247-4db0-822d-72164d27f91b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:33.712892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd0f68ac7774e5db11bae153d716f7f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.717193 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 860/1732] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:40:33.721218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23373402-0247-4db0-822d-72164d27f91b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:33.723389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd0f68ac7774e5db11bae153d716f7f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.724221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd0f68ac7774e5db11bae153d716f7f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.724919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd0f68ac7774e5db11bae153d716f7f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:33.731335 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23373402-0247-4db0-822d-72164d27f91b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:33.737508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf3b18-a233-48d7-bf23-2f8b7dfac098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:33.738138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf3b18-a233-48d7-bf23-2f8b7dfac098 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:33.738784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf3b18-a233-48d7-bf23-2f8b7dfac098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:33.738784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf3b18-a233-48d7-bf23-2f8b7dfac098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:33.739322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf3b18-a233-48d7-bf23-2f8b7dfac098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:33.739581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 873/1733] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:33 2022] DELETE /identity/v3/users/5cd0f68ac7774e5db11bae153d716f7f => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:33.742872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacf3b18-a233-48d7-bf23-2f8b7dfac098 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:33.780125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 861/1734] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:33 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:33.780701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:33.782184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:33.872351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b913aa-79f0-4e12-8f8d-514279a1be26 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:33.934275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b35c99-500c-4ed1-bc3f-eecac7dcba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:33.934936 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b35c99-500c-4ed1-bc3f-eecac7dcba53 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:33.935222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b35c99-500c-4ed1-bc3f-eecac7dcba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:33.935496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b35c99-500c-4ed1-bc3f-eecac7dcba53 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:33.936263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b35c99-500c-4ed1-bc3f-eecac7dcba53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:33.938333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b35c99-500c-4ed1-bc3f-eecac7dcba53 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:33.962509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 874/1735] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:33 2022] POST /identity/v3/users => generated 284 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:33.966835 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf3b18-a233-48d7-bf23-2f8b7dfac098 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:33.978724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacf3b18-a233-48d7-bf23-2f8b7dfac098 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:33.983597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4477-6103-43b2-ab79-0c504ae4f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:33.984675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4477-6103-43b2-ab79-0c504ae4f944 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:33.984675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4477-6103-43b2-ab79-0c504ae4f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:33.985088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e4477-6103-43b2-ab79-0c504ae4f944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:33.985992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e4477-6103-43b2-ab79-0c504ae4f944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:33.987722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e4477-6103-43b2-ab79-0c504ae4f944 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:33.999505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 862/1736] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:34.003711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b35c99-500c-4ed1-bc3f-eecac7dcba53 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.013899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b35c99-500c-4ed1-bc3f-eecac7dcba53 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.019075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb79f4a-43d6-4cfb-ba5f-f1c86b241684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.019727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb79f4a-43d6-4cfb-ba5f-f1c86b241684 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.020009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb79f4a-43d6-4cfb-ba5f-f1c86b241684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.020316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb79f4a-43d6-4cfb-ba5f-f1c86b241684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.021083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb79f4a-43d6-4cfb-ba5f-f1c86b241684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.022818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb79f4a-43d6-4cfb-ba5f-f1c86b241684 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.034711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 875/1737] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:34.039878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4477-6103-43b2-ab79-0c504ae4f944 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.041204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb79f4a-43d6-4cfb-ba5f-f1c86b241684 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.043028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bbb79f4a-43d6-4cfb-ba5f-f1c86b241684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:34.057472 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb79f4a-43d6-4cfb-ba5f-f1c86b241684 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.058258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e4477-6103-43b2-ab79-0c504ae4f944 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.066257 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25526-85dc-4710-b174-964819aca13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.066720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.067168 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25526-85dc-4710-b174-964819aca13d admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.067439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25526-85dc-4710-b174-964819aca13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.067632 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.067805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25526-85dc-4710-b174-964819aca13d admin admin] PATH_INFO: `/v3/projects/aca961c5e4b94e14bab98927de383526/users/82cc060a727f4c9384220886a35ef188/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.067954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.068286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] PATH_INFO: `/v3/projects/1536dd9d938246629381a424b66b66c2` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.070141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1536dd9d938246629381a424b66b66c2)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.072511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.091773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df25526-85dc-4710-b174-964819aca13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca961c5e4b94e14bab98927de383526, user_id=82cc060a727f4c9384220886a35ef188, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.095397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df25526-85dc-4710-b174-964819aca13d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.110551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:34.110880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 863/1738] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:34 2022] PUT /identity/v3/projects/aca961c5e4b94e14bab98927de383526/users/82cc060a727f4c9384220886a35ef188/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:34.122466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d50a7-6090-4478-9303-b68767da7dd7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.124253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d50a7-6090-4478-9303-b68767da7dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.124253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d50a7-6090-4478-9303-b68767da7dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.158882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-211d50a7-6090-4478-9303-b68767da7dd7 None None] MFA Rules not processed for user `82cc060a727f4c9384220886a35ef188`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:34.160116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-211d50a7-6090-4478-9303-b68767da7dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:34.166117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1536dd9d938246629381a424b66b66c2', 'request_id': 'req-72d4f22e-4110-4792-899d-2182d981bf73'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:34.174597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1536dd9d938246629381a424b66b66c2', 'request_id': 'req-72d4f22e-4110-4792-899d-2182d981bf73'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:34.188545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1536dd9d938246629381a424b66b66c2', 'request_id': 'req-72d4f22e-4110-4792-899d-2182d981bf73'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:34.208967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] The token cache is being invalidate because project 1536dd9d938246629381a424b66b66c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:34.209509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:34.210293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-72d4f22e-4110-4792-899d-2182d981bf73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:34.213667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 876/1739] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:34 2022] DELETE /identity/v3/projects/1536dd9d938246629381a424b66b66c2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:34.218084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dd952-4c14-4132-be5b-33fcba1fa4d4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.218361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dd952-4c14-4132-be5b-33fcba1fa4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.218638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dd952-4c14-4132-be5b-33fcba1fa4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.239626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-fd9dd952-4c14-4132-be5b-33fcba1fa4d4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:34.241951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fd9dd952-4c14-4132-be5b-33fcba1fa4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:34.267855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 864/1740] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:34.268760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d50a7-6090-4478-9303-b68767da7dd7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.270100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-211d50a7-6090-4478-9303-b68767da7dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:34.281872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:34.343924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 877/1741] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:34.352878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516fc0b-9835-401b-b69e-b18e8ad8bc2b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.353442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516fc0b-9835-401b-b69e-b18e8ad8bc2b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.354082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516fc0b-9835-401b-b69e-b18e8ad8bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.378464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4516fc0b-9835-401b-b69e-b18e8ad8bc2b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:34.380365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4516fc0b-9835-401b-b69e-b18e8ad8bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:34.383434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d50a7-6090-4478-9303-b68767da7dd7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.388420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e25d9-0f72-446d-b57c-e624c0ed53a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.389071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e25d9-0f72-446d-b57c-e624c0ed53a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.389338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 878/1742] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:34.389456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e25d9-0f72-446d-b57c-e624c0ed53a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.389637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e25d9-0f72-446d-b57c-e624c0ed53a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.390457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e25d9-0f72-446d-b57c-e624c0ed53a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.392454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e25d9-0f72-446d-b57c-e624c0ed53a4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.393837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516fc0b-9835-401b-b69e-b18e8ad8bc2b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.405157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516fc0b-9835-401b-b69e-b18e8ad8bc2b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.410660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c990-5a62-4d8a-a7a8-d9d55e32c4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.411285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c990-5a62-4d8a-a7a8-d9d55e32c4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.411726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c990-5a62-4d8a-a7a8-d9d55e32c4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.412022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c990-5a62-4d8a-a7a8-d9d55e32c4a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.413542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645c990-5a62-4d8a-a7a8-d9d55e32c4a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:34.413909 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645c990-5a62-4d8a-a7a8-d9d55e32c4a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.415789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645c990-5a62-4d8a-a7a8-d9d55e32c4a9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.424938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 865/1743] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:34 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:34.431490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 879/1744] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:40:34.432583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e25d9-0f72-446d-b57c-e624c0ed53a4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.432724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c990-5a62-4d8a-a7a8-d9d55e32c4a9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.443060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c990-5a62-4d8a-a7a8-d9d55e32c4a9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.503338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e25d9-0f72-446d-b57c-e624c0ed53a4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.508573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebbe4e-f7cf-43a7-936c-f2e81a19ee56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.508877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8fd04-509a-4d98-9712-5c7e75c33e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.509213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebbe4e-f7cf-43a7-936c-f2e81a19ee56 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.509499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebbe4e-f7cf-43a7-936c-f2e81a19ee56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.509670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8fd04-509a-4d98-9712-5c7e75c33e0d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.509766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebbe4e-f7cf-43a7-936c-f2e81a19ee56 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.510347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8fd04-509a-4d98-9712-5c7e75c33e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.510446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebbe4e-f7cf-43a7-936c-f2e81a19ee56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.510648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8fd04-509a-4d98-9712-5c7e75c33e0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.512011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8fd04-509a-4d98-9712-5c7e75c33e0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.512411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebbe4e-f7cf-43a7-936c-f2e81a19ee56 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.514040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b8fd04-509a-4d98-9712-5c7e75c33e0d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.539676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 866/1745] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:34 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:34.543979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebbe4e-f7cf-43a7-936c-f2e81a19ee56 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.551240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 880/1746] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:34 2022] POST /identity/v3/projects => generated 409 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:34.554605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebbe4e-f7cf-43a7-936c-f2e81a19ee56 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.555708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8fd04-509a-4d98-9712-5c7e75c33e0d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.574293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:34.614044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e557b4f-20e3-4b70-902b-aa1405543d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.614946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e557b4f-20e3-4b70-902b-aa1405543d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.615390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e557b4f-20e3-4b70-902b-aa1405543d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.615978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e557b4f-20e3-4b70-902b-aa1405543d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.616936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e557b4f-20e3-4b70-902b-aa1405543d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.618704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e557b4f-20e3-4b70-902b-aa1405543d22 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.623563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8fd04-509a-4d98-9712-5c7e75c33e0d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.628996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8a776-be5d-42c8-8393-e1fab49527ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.629160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 867/1747] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:34.630176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8a776-be5d-42c8-8393-e1fab49527ca admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.633836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e557b4f-20e3-4b70-902b-aa1405543d22 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.645924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8a776-be5d-42c8-8393-e1fab49527ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.646279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8a776-be5d-42c8-8393-e1fab49527ca admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.647260 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e557b4f-20e3-4b70-902b-aa1405543d22 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.649843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8a776-be5d-42c8-8393-e1fab49527ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.651738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8a776-be5d-42c8-8393-e1fab49527ca admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.653024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08910-bf08-4b0b-8e93-99acd622d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.653989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08910-bf08-4b0b-8e93-99acd622d20a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.654345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08910-bf08-4b0b-8e93-99acd622d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.654733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a08910-bf08-4b0b-8e93-99acd622d20a admin admin] PATH_INFO: `/v3/projects/e008a63f709f492f89ca191d512f36c1/users/40a61d8212234dc1a5cc3c4a5b7a9379/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.679596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a08910-bf08-4b0b-8e93-99acd622d20a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e008a63f709f492f89ca191d512f36c1, user_id=40a61d8212234dc1a5cc3c4a5b7a9379, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.683613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a08910-bf08-4b0b-8e93-99acd622d20a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.689303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:34.698262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 881/1748] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:34 2022] POST /identity/v3/users => generated 305 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:34.702005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8a776-be5d-42c8-8393-e1fab49527ca admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.706539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f7c8a776-be5d-42c8-8393-e1fab49527ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:34.714783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 868/1749] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:34 2022] PUT /identity/v3/projects/e008a63f709f492f89ca191d512f36c1/users/40a61d8212234dc1a5cc3c4a5b7a9379/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:34.715614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08910-bf08-4b0b-8e93-99acd622d20a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.727296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8a776-be5d-42c8-8393-e1fab49527ca admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.850523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a08910-bf08-4b0b-8e93-99acd622d20a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.856842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27133b0d-8661-4fea-898e-6c5937aff820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.857637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27133b0d-8661-4fea-898e-6c5937aff820 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.858185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27133b0d-8661-4fea-898e-6c5937aff820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.858597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27133b0d-8661-4fea-898e-6c5937aff820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.860446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27133b0d-8661-4fea-898e-6c5937aff820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.862683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27133b0d-8661-4fea-898e-6c5937aff820 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.865617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.867082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.867406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.867684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] PATH_INFO: `/v3/users/76e1a26fdb34482a9ce11a08698e0907` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.869097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e1a26fdb34482a9ce11a08698e0907)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.871051 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.877122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 869/1750] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:34.878076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27133b0d-8661-4fea-898e-6c5937aff820 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.895114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27133b0d-8661-4fea-898e-6c5937aff820 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.912093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c7810-4c08-4fb5-b676-ba602647346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.912817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7810-4c08-4fb5-b676-ba602647346c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.913172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7810-4c08-4fb5-b676-ba602647346c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.913457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632c7810-4c08-4fb5-b676-ba602647346c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.914154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c7810-4c08-4fb5-b676-ba602647346c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.915869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632c7810-4c08-4fb5-b676-ba602647346c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.927413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 870/1751] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:34.928934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c7810-4c08-4fb5-b676-ba602647346c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.944627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632c7810-4c08-4fb5-b676-ba602647346c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.948530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e1a26fdb34482a9ce11a08698e0907'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:34.951762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f119f80-6cb5-45f6-98c3-69bd3c02706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.953122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119f80-6cb5-45f6-98c3-69bd3c02706c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.953411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119f80-6cb5-45f6-98c3-69bd3c02706c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.953689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f119f80-6cb5-45f6-98c3-69bd3c02706c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.954427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f119f80-6cb5-45f6-98c3-69bd3c02706c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:34.956073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f119f80-6cb5-45f6-98c3-69bd3c02706c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:34.970639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 871/1752] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:34.975896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f119f80-6cb5-45f6-98c3-69bd3c02706c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:34.986665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e1a26fdb34482a9ce11a08698e0907'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:34.990013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f119f80-6cb5-45f6-98c3-69bd3c02706c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:34.995458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e1a26fdb34482a9ce11a08698e0907'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:34.996453 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cff30a-d709-4356-80ca-dc50cb7a028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:34.997000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e1a26fdb34482a9ce11a08698e0907'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:34.997271 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff30a-d709-4356-80ca-dc50cb7a028a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:34.997571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff30a-d709-4356-80ca-dc50cb7a028a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:34.997966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cff30a-d709-4356-80ca-dc50cb7a028a admin admin] PATH_INFO: `/v3/projects/e008a63f709f492f89ca191d512f36c1/users/40a61d8212234dc1a5cc3c4a5b7a9379/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:34.998951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e1a26fdb34482a9ce11a08698e0907'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:35.001298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cff30a-d709-4356-80ca-dc50cb7a028a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e008a63f709f492f89ca191d512f36c1, user_id=40a61d8212234dc1a5cc3c4a5b7a9379, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.005588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cff30a-d709-4356-80ca-dc50cb7a028a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.018345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 882/1753] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:34 2022] DELETE /identity/v3/users/76e1a26fdb34482a9ce11a08698e0907 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:35.019247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.020771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:35.021869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 872/1754] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:34 2022] PUT /identity/v3/projects/e008a63f709f492f89ca191d512f36c1/users/40a61d8212234dc1a5cc3c4a5b7a9379/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:35.024024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c41e98-ef2d-488e-b7a3-09f273c80d49 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.024398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c41e98-ef2d-488e-b7a3-09f273c80d49 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.024710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c41e98-ef2d-488e-b7a3-09f273c80d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.058595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c0c41e98-ef2d-488e-b7a3-09f273c80d49 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:35.061405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c0c41e98-ef2d-488e-b7a3-09f273c80d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:35.071127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:35.128012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb2996-058a-49f7-b92a-a1ae30e51702 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.134828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8cba9-2ce4-4a90-ac5b-af452d2094f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.138529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8cba9-2ce4-4a90-ac5b-af452d2094f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.138529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8cba9-2ce4-4a90-ac5b-af452d2094f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.138529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8cba9-2ce4-4a90-ac5b-af452d2094f2 admin admin] PATH_INFO: `/v3/projects/ec2bfc9a02674c2da7292319b62d536a/users/c609e8a74a7948b798a14697f3644bfc/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.140495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 873/1755] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:35.147375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57283f3c-c55d-4618-9d8f-082a03e042f6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.147555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57283f3c-c55d-4618-9d8f-082a03e042f6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.147714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57283f3c-c55d-4618-9d8f-082a03e042f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.156965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8cba9-2ce4-4a90-ac5b-af452d2094f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2bfc9a02674c2da7292319b62d536a, user_id=c609e8a74a7948b798a14697f3644bfc, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.160043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8cba9-2ce4-4a90-ac5b-af452d2094f2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.187663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 883/1756] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:35 2022] PUT /identity/v3/projects/ec2bfc9a02674c2da7292319b62d536a/users/c609e8a74a7948b798a14697f3644bfc/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:35.187853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-57283f3c-c55d-4618-9d8f-082a03e042f6 None None] MFA Rules not processed for user `40a61d8212234dc1a5cc3c4a5b7a9379`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:35.187978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8cba9-2ce4-4a90-ac5b-af452d2094f2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.188072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-57283f3c-c55d-4618-9d8f-082a03e042f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:35.193386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9dc8cba9-2ce4-4a90-ac5b-af452d2094f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:35.246729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:35.256457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8cba9-2ce4-4a90-ac5b-af452d2094f2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.262081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b447-dba4-4039-a500-89bd31f843d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.262913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b447-dba4-4039-a500-89bd31f843d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.263074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b447-dba4-4039-a500-89bd31f843d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.263465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30b447-dba4-4039-a500-89bd31f843d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.279402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 874/1757] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:35.279402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507390fc-a7a5-4497-9f95-01f17a287bca None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.279402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507390fc-a7a5-4497-9f95-01f17a287bca None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.279402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507390fc-a7a5-4497-9f95-01f17a287bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.307609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-507390fc-a7a5-4497-9f95-01f17a287bca None None] MFA Rules not processed for user `c609e8a74a7948b798a14697f3644bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:35.309428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-507390fc-a7a5-4497-9f95-01f17a287bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:35.330353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30b447-dba4-4039-a500-89bd31f843d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.331935 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30b447-dba4-4039-a500-89bd31f843d8 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.343391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 884/1758] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:35.344083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b447-dba4-4039-a500-89bd31f843d8 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.346756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6d30b447-dba4-4039-a500-89bd31f843d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:35.402842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 875/1759] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:35 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:35.405477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507390fc-a7a5-4497-9f95-01f17a287bca None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.425876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507390fc-a7a5-4497-9f95-01f17a287bca None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.428230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30b447-dba4-4039-a500-89bd31f843d8 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.434085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc17d4-6028-49ef-aa76-7cb1895dfa74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.434971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc17d4-6028-49ef-aa76-7cb1895dfa74 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.435594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc17d4-6028-49ef-aa76-7cb1895dfa74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.435984 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc17d4-6028-49ef-aa76-7cb1895dfa74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.436356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3863bb2-6c26-4e81-b559-0e6ccff4a9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.437494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3863bb2-6c26-4e81-b559-0e6ccff4a9e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.438144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3863bb2-6c26-4e81-b559-0e6ccff4a9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.438620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3863bb2-6c26-4e81-b559-0e6ccff4a9e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.439497 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3863bb2-6c26-4e81-b559-0e6ccff4a9e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.442125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3863bb2-6c26-4e81-b559-0e6ccff4a9e0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.450109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc17d4-6028-49ef-aa76-7cb1895dfa74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.451841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc17d4-6028-49ef-aa76-7cb1895dfa74 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.467759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 885/1760] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:35.486724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 876/1761] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:35 2022] POST /identity/v3/projects => generated 409 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:35.491775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc17d4-6028-49ef-aa76-7cb1895dfa74 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.503137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:35.519596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc17d4-6028-49ef-aa76-7cb1895dfa74 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.540943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3863bb2-6c26-4e81-b559-0e6ccff4a9e0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.620940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3863bb2-6c26-4e81-b559-0e6ccff4a9e0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.625780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed8b62-a5fe-44a0-8a85-89f72aa2d503 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.626640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed8b62-a5fe-44a0-8a85-89f72aa2d503 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.626979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed8b62-a5fe-44a0-8a85-89f72aa2d503 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.627322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed8b62-a5fe-44a0-8a85-89f72aa2d503 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.629340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1bed8b62-a5fe-44a0-8a85-89f72aa2d503 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:35.632347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb45460-37b1-4973-940b-c4aafc627b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.633261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb45460-37b1-4973-940b-c4aafc627b2a admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.634326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb45460-37b1-4973-940b-c4aafc627b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.634679 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb45460-37b1-4973-940b-c4aafc627b2a admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.635486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb45460-37b1-4973-940b-c4aafc627b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.638179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb45460-37b1-4973-940b-c4aafc627b2a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.670052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 886/1762] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:35 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:35.672058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb45460-37b1-4973-940b-c4aafc627b2a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.684293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb45460-37b1-4973-940b-c4aafc627b2a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.690982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a08d42-fe9a-494d-be9d-445f1a57105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.690982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a08d42-fe9a-494d-be9d-445f1a57105a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.691192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a08d42-fe9a-494d-be9d-445f1a57105a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.691454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a08d42-fe9a-494d-be9d-445f1a57105a admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.692196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a08d42-fe9a-494d-be9d-445f1a57105a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.693790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a08d42-fe9a-494d-be9d-445f1a57105a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.711799 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 887/1763] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:35.713259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a08d42-fe9a-494d-be9d-445f1a57105a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.716812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed8b62-a5fe-44a0-8a85-89f72aa2d503 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.718415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed8b62-a5fe-44a0-8a85-89f72aa2d503 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.726828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a08d42-fe9a-494d-be9d-445f1a57105a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.731269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 877/1764] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:35.735327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea1a2-055a-498e-83b6-da77134bd705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.736011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea1a2-055a-498e-83b6-da77134bd705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.736463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea1a2-055a-498e-83b6-da77134bd705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.736879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea1a2-055a-498e-83b6-da77134bd705 admin admin] PATH_INFO: `/v3/projects/cb5ca3a743e44f30a059f722e9d850b0/users/16bbc1fc83814253ac5fc6f216cece0c/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.761301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ea1a2-055a-498e-83b6-da77134bd705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5ca3a743e44f30a059f722e9d850b0, user_id=16bbc1fc83814253ac5fc6f216cece0c, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.765592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ea1a2-055a-498e-83b6-da77134bd705 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.791024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 888/1765] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:35 2022] PUT /identity/v3/projects/cb5ca3a743e44f30a059f722e9d850b0/users/16bbc1fc83814253ac5fc6f216cece0c/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:35.792237 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed8b62-a5fe-44a0-8a85-89f72aa2d503 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.806117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:35.811623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed8b62-a5fe-44a0-8a85-89f72aa2d503 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.891124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea1a2-055a-498e-83b6-da77134bd705 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.893079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4b4ea1a2-055a-498e-83b6-da77134bd705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:35.896052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f626a-6fdc-4316-a07f-66e6d13db1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.896889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f626a-6fdc-4316-a07f-66e6d13db1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.898023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f626a-6fdc-4316-a07f-66e6d13db1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.898330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f626a-6fdc-4316-a07f-66e6d13db1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.899605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f626a-6fdc-4316-a07f-66e6d13db1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.902711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f626a-6fdc-4316-a07f-66e6d13db1a7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.916060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea1a2-055a-498e-83b6-da77134bd705 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.922821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.923676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 878/1766] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:35.924026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.924450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.924741 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] PATH_INFO: `/v3/projects/2ad579f213984b3fb8281530d46fcc99` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.925961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ad579f213984b3fb8281530d46fcc99)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.927779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f626a-6fdc-4316-a07f-66e6d13db1a7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:35.928438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.950281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f626a-6fdc-4316-a07f-66e6d13db1a7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:35.955107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e06d1-7098-4354-8b43-b0d6e0dcb1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:35.955784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e06d1-7098-4354-8b43-b0d6e0dcb1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.956069 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e06d1-7098-4354-8b43-b0d6e0dcb1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.956853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e06d1-7098-4354-8b43-b0d6e0dcb1b2 admin admin] PATH_INFO: `/v3/projects/cb5ca3a743e44f30a059f722e9d850b0/users/16bbc1fc83814253ac5fc6f216cece0c/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.959000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e06d1-7098-4354-8b43-b0d6e0dcb1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb5ca3a743e44f30a059f722e9d850b0, user_id=16bbc1fc83814253ac5fc6f216cece0c, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:35.962683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e06d1-7098-4354-8b43-b0d6e0dcb1b2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:35.976179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 879/1767] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:35 2022] PUT /identity/v3/projects/cb5ca3a743e44f30a059f722e9d850b0/users/16bbc1fc83814253ac5fc6f216cece0c/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:35.987126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be47a2-9d66-4663-b311-dd8c04f9e3ab None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:35.987410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be47a2-9d66-4663-b311-dd8c04f9e3ab None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:35.987690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be47a2-9d66-4663-b311-dd8c04f9e3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:35.996936 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ad579f213984b3fb8281530d46fcc99', 'request_id': 'req-547104ff-f31d-45ad-a947-6f75fda574b2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.004739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ad579f213984b3fb8281530d46fcc99', 'request_id': 'req-547104ff-f31d-45ad-a947-6f75fda574b2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.014157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ad579f213984b3fb8281530d46fcc99', 'request_id': 'req-547104ff-f31d-45ad-a947-6f75fda574b2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.018156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-92be47a2-9d66-4663-b311-dd8c04f9e3ab None None] MFA Rules not processed for user `16bbc1fc83814253ac5fc6f216cece0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:36.019443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-92be47a2-9d66-4663-b311-dd8c04f9e3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:36.044333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] The token cache is being invalidate because project 2ad579f213984b3fb8281530d46fcc99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:36.044928 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.045759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.050428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 889/1768] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:35 2022] DELETE /identity/v3/projects/2ad579f213984b3fb8281530d46fcc99 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:36.053560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:36.055286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:36.137561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:36.143379 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 880/1769] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:35 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:36.161838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be47a2-9d66-4663-b311-dd8c04f9e3ab None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:36.164104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-92be47a2-9d66-4663-b311-dd8c04f9e3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:36.177990 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547104ff-f31d-45ad-a947-6f75fda574b2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:36.189900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:36.190773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:36.191232 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:36.191790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] PATH_INFO: `/v3/users/108d633f32b64f2a9498c0628969cce9` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:36.193148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=108d633f32b64f2a9498c0628969cce9)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:36.195993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:36.238366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be47a2-9d66-4663-b311-dd8c04f9e3ab None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:36.242940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d7571-4408-4586-8901-ae2dbb2797c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:36.243539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d7571-4408-4586-8901-ae2dbb2797c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:36.243818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d7571-4408-4586-8901-ae2dbb2797c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:36.244093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d7571-4408-4586-8901-ae2dbb2797c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:36.254209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d7571-4408-4586-8901-ae2dbb2797c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:36.255660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d7571-4408-4586-8901-ae2dbb2797c3 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:36.266138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108d633f32b64f2a9498c0628969cce9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.266388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 881/1770] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:36 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:36.280307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108d633f32b64f2a9498c0628969cce9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.287442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108d633f32b64f2a9498c0628969cce9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.288812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108d633f32b64f2a9498c0628969cce9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.289427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108d633f32b64f2a9498c0628969cce9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.306668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 890/1771] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:36 2022] DELETE /identity/v3/users/108d633f32b64f2a9498c0628969cce9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:36.460773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d7571-4408-4586-8901-ae2dbb2797c3 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:36.476620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d7571-4408-4586-8901-ae2dbb2797c3 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:36.494412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:36.548022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c6c0aa-eabc-48ee-9fe7-efaff5a0fc0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:36.548741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6c0aa-eabc-48ee-9fe7-efaff5a0fc0e service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:36.549033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6c0aa-eabc-48ee-9fe7-efaff5a0fc0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:36.549311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c6c0aa-eabc-48ee-9fe7-efaff5a0fc0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:36.551114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f4c6c0aa-eabc-48ee-9fe7-efaff5a0fc0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:36.609368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:36.611119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:36.633903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6c0aa-eabc-48ee-9fe7-efaff5a0fc0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:36.635347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c6c0aa-eabc-48ee-9fe7-efaff5a0fc0e service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:36.652451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 882/1772] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:36 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:36.690316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7737760f-6c07-4902-99fa-e0f333caafdd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:36.699514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:36.700267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:36.700499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:36.700770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] PATH_INFO: `/v3/projects/845f52d614c341d3aa4684e2c45e284d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:36.701972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] RBAC: Authorizing `identity:delete_project(project_id=845f52d614c341d3aa4684e2c45e284d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:36.703892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:36.753169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '845f52d614c341d3aa4684e2c45e284d', 'request_id': 'req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.759918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '845f52d614c341d3aa4684e2c45e284d', 'request_id': 'req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.767732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '845f52d614c341d3aa4684e2c45e284d', 'request_id': 'req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.769005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:36.781606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] The token cache is being invalidate because project 845f52d614c341d3aa4684e2c45e284d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:36.781891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.782631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d34dfc35-9b69-4f7f-b2cc-9a801250b40a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:36.784280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 891/1773] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:36 2022] DELETE /identity/v3/projects/845f52d614c341d3aa4684e2c45e284d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:36.789282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2a080-6ae0-4bb3-8a51-dd6432cbc0cb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:36.789569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2a080-6ae0-4bb3-8a51-dd6432cbc0cb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:36.789855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2a080-6ae0-4bb3-8a51-dd6432cbc0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:36.811857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1de2a080-6ae0-4bb3-8a51-dd6432cbc0cb None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:36.813417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1de2a080-6ae0-4bb3-8a51-dd6432cbc0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:36.906358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 883/1774] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:36.915871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fa06c-f565-4884-92b7-5834ea6279d5 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:36.916347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fa06c-f565-4884-92b7-5834ea6279d5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:36.916583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597fa06c-f565-4884-92b7-5834ea6279d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:36.945982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-597fa06c-f565-4884-92b7-5834ea6279d5 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:36.947465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-597fa06c-f565-4884-92b7-5834ea6279d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:36.969673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2a080-6ae0-4bb3-8a51-dd6432cbc0cb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:36.970299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 892/1775] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:36.981234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2a080-6ae0-4bb3-8a51-dd6432cbc0cb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:36.993929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de8fb9-164e-496a-8e77-63ff90747243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:36.994727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de8fb9-164e-496a-8e77-63ff90747243 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:36.995048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de8fb9-164e-496a-8e77-63ff90747243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:36.996400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de8fb9-164e-496a-8e77-63ff90747243 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:36.997160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de8fb9-164e-496a-8e77-63ff90747243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:36.997474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de8fb9-164e-496a-8e77-63ff90747243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:36.999856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de8fb9-164e-496a-8e77-63ff90747243 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.014433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 884/1776] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:40:37.018982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fa06c-f565-4884-92b7-5834ea6279d5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.029718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597fa06c-f565-4884-92b7-5834ea6279d5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.035344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4ce25-077f-4c9d-a5b5-4c0b081246f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.035969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4ce25-077f-4c9d-a5b5-4c0b081246f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.036296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4ce25-077f-4c9d-a5b5-4c0b081246f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.036576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f4ce25-077f-4c9d-a5b5-4c0b081246f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.037418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4ce25-077f-4c9d-a5b5-4c0b081246f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.040444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f4ce25-077f-4c9d-a5b5-4c0b081246f6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.070911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 893/1777] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:37 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:37.075066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de8fb9-164e-496a-8e77-63ff90747243 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.085486 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de8fb9-164e-496a-8e77-63ff90747243 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.135965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:37.142262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa518-6551-40b4-95ee-e272e4769469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.142882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa518-6551-40b4-95ee-e272e4769469 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.143167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa518-6551-40b4-95ee-e272e4769469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.143439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aa518-6551-40b4-95ee-e272e4769469 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.144164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aa518-6551-40b4-95ee-e272e4769469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.146079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aa518-6551-40b4-95ee-e272e4769469 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.169924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 885/1778] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:37 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:37.173234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4ce25-077f-4c9d-a5b5-4c0b081246f6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.184912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f4ce25-077f-4c9d-a5b5-4c0b081246f6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.190059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f3ece-15f8-40f3-9429-885b06feb2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.190680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f3ece-15f8-40f3-9429-885b06feb2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.190958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f3ece-15f8-40f3-9429-885b06feb2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.191252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f3ece-15f8-40f3-9429-885b06feb2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.191955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f3ece-15f8-40f3-9429-885b06feb2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.193913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f3ece-15f8-40f3-9429-885b06feb2cd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.207191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 894/1779] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:37.211665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa518-6551-40b4-95ee-e272e4769469 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.222133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aa518-6551-40b4-95ee-e272e4769469 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.227240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08821d85-cd44-4d91-bb3d-201da5e11e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.227857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08821d85-cd44-4d91-bb3d-201da5e11e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.228156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08821d85-cd44-4d91-bb3d-201da5e11e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.228442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08821d85-cd44-4d91-bb3d-201da5e11e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.229415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08821d85-cd44-4d91-bb3d-201da5e11e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.230999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08821d85-cd44-4d91-bb3d-201da5e11e0f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.249586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 886/1780] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:37.251853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f3ece-15f8-40f3-9429-885b06feb2cd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.263194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f3ece-15f8-40f3-9429-885b06feb2cd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.270070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76d18-d8d4-4a1b-be6a-5d07549b3acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.270816 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76d18-d8d4-4a1b-be6a-5d07549b3acb admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.271294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76d18-d8d4-4a1b-be6a-5d07549b3acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.271575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa76d18-d8d4-4a1b-be6a-5d07549b3acb admin admin] PATH_INFO: `/v3/projects/b0ad320548d8489e8bc558bdc9773113/users/6244a938cda14c2284fc8a93a8532ae2/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.291556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa76d18-d8d4-4a1b-be6a-5d07549b3acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ad320548d8489e8bc558bdc9773113, user_id=6244a938cda14c2284fc8a93a8532ae2, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.294328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa76d18-d8d4-4a1b-be6a-5d07549b3acb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.310628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 895/1781] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:37 2022] PUT /identity/v3/projects/b0ad320548d8489e8bc558bdc9773113/users/6244a938cda14c2284fc8a93a8532ae2/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:37.321456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb88377-307f-443f-b9e8-5c826f7f1aee None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.321881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb88377-307f-443f-b9e8-5c826f7f1aee None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.322489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb88377-307f-443f-b9e8-5c826f7f1aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.354832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7cb88377-307f-443f-b9e8-5c826f7f1aee None None] MFA Rules not processed for user `6244a938cda14c2284fc8a93a8532ae2`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:37.356054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7cb88377-307f-443f-b9e8-5c826f7f1aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:37.437117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 887/1782] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:37.441608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76d18-d8d4-4a1b-be6a-5d07549b3acb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.510241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa76d18-d8d4-4a1b-be6a-5d07549b3acb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.515032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e1938-109f-4837-b384-42eed5149315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.515665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e1938-109f-4837-b384-42eed5149315 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.515952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e1938-109f-4837-b384-42eed5149315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.516264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e1938-109f-4837-b384-42eed5149315 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.517378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e1938-109f-4837-b384-42eed5149315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.518963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e1938-109f-4837-b384-42eed5149315 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.549523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 896/1783] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:37 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:37.554378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb88377-307f-443f-b9e8-5c826f7f1aee None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.568593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb88377-307f-443f-b9e8-5c826f7f1aee None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.653102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f73ee-29a5-45eb-95dd-94eacb319e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.653735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f73ee-29a5-45eb-95dd-94eacb319e46 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.654162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f73ee-29a5-45eb-95dd-94eacb319e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.654449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f73ee-29a5-45eb-95dd-94eacb319e46 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.655125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f73ee-29a5-45eb-95dd-94eacb319e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.657072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f73ee-29a5-45eb-95dd-94eacb319e46 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.682569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 888/1784] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:37 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:37.686568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e1938-109f-4837-b384-42eed5149315 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.697280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e1938-109f-4837-b384-42eed5149315 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.701895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158697a-646c-40fb-87b6-a5bbc5b0ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.702503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158697a-646c-40fb-87b6-a5bbc5b0ea48 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.702960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158697a-646c-40fb-87b6-a5bbc5b0ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.703273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c158697a-646c-40fb-87b6-a5bbc5b0ea48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.703985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158697a-646c-40fb-87b6-a5bbc5b0ea48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.705595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c158697a-646c-40fb-87b6-a5bbc5b0ea48 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.716250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 897/1785] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:37.720341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f73ee-29a5-45eb-95dd-94eacb319e46 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.731240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f73ee-29a5-45eb-95dd-94eacb319e46 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.735909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4954f-90e6-4590-98a8-1976b5f61b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.736727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4954f-90e6-4590-98a8-1976b5f61b98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.737017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4954f-90e6-4590-98a8-1976b5f61b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.737299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4954f-90e6-4590-98a8-1976b5f61b98 admin admin] PATH_INFO: `/v3/projects/be64c143d5e14d0ea44bac820a9295b5/users/fb129d6b677340c7b461fdc997c46b0b/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.752878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4954f-90e6-4590-98a8-1976b5f61b98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be64c143d5e14d0ea44bac820a9295b5, user_id=fb129d6b677340c7b461fdc997c46b0b, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.755729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4954f-90e6-4590-98a8-1976b5f61b98 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.769363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 889/1786] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:37 2022] PUT /identity/v3/projects/be64c143d5e14d0ea44bac820a9295b5/users/fb129d6b677340c7b461fdc997c46b0b/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:37.773289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158697a-646c-40fb-87b6-a5bbc5b0ea48 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.783466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c158697a-646c-40fb-87b6-a5bbc5b0ea48 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.848616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a133baa-49f8-4646-8cd1-298a6e032e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.849245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a133baa-49f8-4646-8cd1-298a6e032e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.849530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a133baa-49f8-4646-8cd1-298a6e032e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.850820 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a133baa-49f8-4646-8cd1-298a6e032e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.851066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a133baa-49f8-4646-8cd1-298a6e032e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.852730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a133baa-49f8-4646-8cd1-298a6e032e7d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.854058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:37.864459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 898/1787] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:37.868786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4954f-90e6-4590-98a8-1976b5f61b98 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:37.879051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4954f-90e6-4590-98a8-1976b5f61b98 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:37.883734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c57f-4494-4759-97d2-7350d4bd1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:37.884430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c57f-4494-4759-97d2-7350d4bd1160 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.884712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c57f-4494-4759-97d2-7350d4bd1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.884987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551c57f-4494-4759-97d2-7350d4bd1160 admin admin] PATH_INFO: `/v3/projects/be64c143d5e14d0ea44bac820a9295b5/users/fb129d6b677340c7b461fdc997c46b0b/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.886925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551c57f-4494-4759-97d2-7350d4bd1160 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be64c143d5e14d0ea44bac820a9295b5, user_id=fb129d6b677340c7b461fdc997c46b0b, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:37.889584 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551c57f-4494-4759-97d2-7350d4bd1160 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:37.900380 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 890/1788] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:37 2022] PUT /identity/v3/projects/be64c143d5e14d0ea44bac820a9295b5/users/fb129d6b677340c7b461fdc997c46b0b/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:37.910678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609bc6e-c2fc-42d8-b00a-d7ad117f28f8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:37.910967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609bc6e-c2fc-42d8-b00a-d7ad117f28f8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:37.911244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609bc6e-c2fc-42d8-b00a-d7ad117f28f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:37.939986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e609bc6e-c2fc-42d8-b00a-d7ad117f28f8 None None] MFA Rules not processed for user `fb129d6b677340c7b461fdc997c46b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:37.941235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e609bc6e-c2fc-42d8-b00a-d7ad117f28f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:38.012406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 899/1789] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:38.034881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c57f-4494-4759-97d2-7350d4bd1160 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:38.036597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7551c57f-4494-4759-97d2-7350d4bd1160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:38.058034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:38.096218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551c57f-4494-4759-97d2-7350d4bd1160 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:38.099778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de01f2-bf1a-441a-bba7-45b1df4a5d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:38.101034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de01f2-bf1a-441a-bba7-45b1df4a5d6d service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:38.101312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de01f2-bf1a-441a-bba7-45b1df4a5d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:38.101579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de01f2-bf1a-441a-bba7-45b1df4a5d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:38.110777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de01f2-bf1a-441a-bba7-45b1df4a5d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:38.112227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de01f2-bf1a-441a-bba7-45b1df4a5d6d service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:38.121827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 891/1790] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:38 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:38.259782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609bc6e-c2fc-42d8-b00a-d7ad117f28f8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:38.320115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609bc6e-c2fc-42d8-b00a-d7ad117f28f8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:38.324752 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:38.325407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:38.325688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:38.325963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] PATH_INFO: `/v3/users/6244a938cda14c2284fc8a93a8532ae2` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:38.327109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6244a938cda14c2284fc8a93a8532ae2)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:38.329135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:38.373250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6244a938cda14c2284fc8a93a8532ae2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:38.384807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6244a938cda14c2284fc8a93a8532ae2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:38.391617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6244a938cda14c2284fc8a93a8532ae2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:38.392310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6244a938cda14c2284fc8a93a8532ae2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:38.392924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6244a938cda14c2284fc8a93a8532ae2'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:38.401608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:38.407073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 900/1791] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:38 2022] DELETE /identity/v3/users/6244a938cda14c2284fc8a93a8532ae2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:38.411694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2580b-e68d-428b-99ee-2ea13d252783 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:38.412000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2580b-e68d-428b-99ee-2ea13d252783 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:38.412322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2580b-e68d-428b-99ee-2ea13d252783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:38.431580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8ea2580b-e68d-428b-99ee-2ea13d252783 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:38.432791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8ea2580b-e68d-428b-99ee-2ea13d252783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:38.493307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 892/1792] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:38.503006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:38.504450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:38.562371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7da036-c46e-4b94-bc97-63fda4f5c616 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:38.566117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387d61b-996c-48ee-8466-9d7c2daaf0f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:38.566740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d61b-996c-48ee-8466-9d7c2daaf0f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:38.567011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d61b-996c-48ee-8466-9d7c2daaf0f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:38.567281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d61b-996c-48ee-8466-9d7c2daaf0f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:38.577079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387d61b-996c-48ee-8466-9d7c2daaf0f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:38.579259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387d61b-996c-48ee-8466-9d7c2daaf0f0 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:38.590200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 901/1793] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:38.967971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2580b-e68d-428b-99ee-2ea13d252783 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:38.967971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8ea2580b-e68d-428b-99ee-2ea13d252783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:38.980477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2580b-e68d-428b-99ee-2ea13d252783 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:38.986041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:38.986707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:38.986997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:38.987248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] PATH_INFO: `/v3/projects/b0ad320548d8489e8bc558bdc9773113` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:38.988528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ad320548d8489e8bc558bdc9773113)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:38.991338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:39.050865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ad320548d8489e8bc558bdc9773113', 'request_id': 'req-9ff7113f-28ba-43b7-8744-5141be672bd3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.060874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ad320548d8489e8bc558bdc9773113', 'request_id': 'req-9ff7113f-28ba-43b7-8744-5141be672bd3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.072344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ad320548d8489e8bc558bdc9773113', 'request_id': 'req-9ff7113f-28ba-43b7-8744-5141be672bd3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.090360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] The token cache is being invalidate because project b0ad320548d8489e8bc558bdc9773113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:39.090850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.091863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.094461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 893/1794] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:38 2022] DELETE /identity/v3/projects/b0ad320548d8489e8bc558bdc9773113 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:39.098733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387d61b-996c-48ee-8466-9d7c2daaf0f0 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:39.110265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387d61b-996c-48ee-8466-9d7c2daaf0f0 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:39.187664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:39.188787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:39.189144 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:39.189490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] PATH_INFO: `/v3/users/fb129d6b677340c7b461fdc997c46b0b` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:39.191046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb129d6b677340c7b461fdc997c46b0b)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:39.195328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:39.250274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb129d6b677340c7b461fdc997c46b0b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.268964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb129d6b677340c7b461fdc997c46b0b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.278380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb129d6b677340c7b461fdc997c46b0b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.279129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb129d6b677340c7b461fdc997c46b0b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.279742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb129d6b677340c7b461fdc997c46b0b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.298735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 902/1795] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:39 2022] DELETE /identity/v3/users/fb129d6b677340c7b461fdc997c46b0b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:39.377569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:39.379126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:39.394401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7113f-28ba-43b7-8744-5141be672bd3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:39.439261 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:39.462360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:39.463466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:39.463904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:39.464915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] PATH_INFO: `/v3/users/82cc060a727f4c9384220886a35ef188` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:39.469016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cc060a727f4c9384220886a35ef188)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:39.471056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:39.610917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cc060a727f4c9384220886a35ef188'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.621307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cc060a727f4c9384220886a35ef188'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.630070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cc060a727f4c9384220886a35ef188'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.630735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cc060a727f4c9384220886a35ef188'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.632601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2ee0e4e2-8363-495e-bc7f-ffac73e9df6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cc060a727f4c9384220886a35ef188'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.669011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:39.672596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 894/1796] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:39 2022] DELETE /identity/v3/users/82cc060a727f4c9384220886a35ef188 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:39.672725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:39.674326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec2602-66d4-490f-9e51-c14ed051060d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:39.674686 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec2602-66d4-490f-9e51-c14ed051060d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:39.674966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec2602-66d4-490f-9e51-c14ed051060d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:39.694053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0663f3-15e1-4fe4-8f1d-b95448618290 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:39.696225 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cbec2602-66d4-490f-9e51-c14ed051060d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:39.697450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cbec2602-66d4-490f-9e51-c14ed051060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:39.721761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:39.766277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 895/1797] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:39.771926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:39.772677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:39.772959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:39.773235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] PATH_INFO: `/v3/projects/be64c143d5e14d0ea44bac820a9295b5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:39.774477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be64c143d5e14d0ea44bac820a9295b5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:39.776913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:39.777384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec2602-66d4-490f-9e51-c14ed051060d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:39.778873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cbec2602-66d4-490f-9e51-c14ed051060d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:39.837455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be64c143d5e14d0ea44bac820a9295b5', 'request_id': 'req-4375ebbe-afc7-4241-a363-8b3f8149bb88'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.844447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be64c143d5e14d0ea44bac820a9295b5', 'request_id': 'req-4375ebbe-afc7-4241-a363-8b3f8149bb88'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.849269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec2602-66d4-490f-9e51-c14ed051060d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:39.864427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be64c143d5e14d0ea44bac820a9295b5', 'request_id': 'req-4375ebbe-afc7-4241-a363-8b3f8149bb88'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.874773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:39.893060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] The token cache is being invalidate because project be64c143d5e14d0ea44bac820a9295b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:39.893736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.894806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4375ebbe-afc7-4241-a363-8b3f8149bb88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:39.899263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 903/1798] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:39 2022] DELETE /identity/v3/projects/be64c143d5e14d0ea44bac820a9295b5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:39.904200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72233cb-18b3-4b7b-893a-8321c4d9bd0b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:39.904578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72233cb-18b3-4b7b-893a-8321c4d9bd0b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:39.904931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72233cb-18b3-4b7b-893a-8321c4d9bd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:39.922276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006817ed-f370-410a-b0f1-dc0cd25bdc09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:39.923273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006817ed-f370-410a-b0f1-dc0cd25bdc09 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:39.923766 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006817ed-f370-410a-b0f1-dc0cd25bdc09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:39.924347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006817ed-f370-410a-b0f1-dc0cd25bdc09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:39.926792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-006817ed-f370-410a-b0f1-dc0cd25bdc09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:39.931002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d72233cb-18b3-4b7b-893a-8321c4d9bd0b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:39.932983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d72233cb-18b3-4b7b-893a-8321c4d9bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:39.998421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 904/1799] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:40.008625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821f7d-f2e1-408b-92be-53c6a674263c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.009595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821f7d-f2e1-408b-92be-53c6a674263c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.009895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821f7d-f2e1-408b-92be-53c6a674263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.011491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006817ed-f370-410a-b0f1-dc0cd25bdc09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.012975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006817ed-f370-410a-b0f1-dc0cd25bdc09 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.028434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 896/1800] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:40.044162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d8821f7d-f2e1-408b-92be-53c6a674263c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:40.045511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d8821f7d-f2e1-408b-92be-53c6a674263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:40.054136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 905/1801] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:40.058359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006817ed-f370-410a-b0f1-dc0cd25bdc09 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.068836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006817ed-f370-410a-b0f1-dc0cd25bdc09 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.073593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5afb98-4554-4b27-ad80-9091ae2dc758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.074217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5afb98-4554-4b27-ad80-9091ae2dc758 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.074502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5afb98-4554-4b27-ad80-9091ae2dc758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.074776 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5afb98-4554-4b27-ad80-9091ae2dc758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.075468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5afb98-4554-4b27-ad80-9091ae2dc758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:40.075804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5afb98-4554-4b27-ad80-9091ae2dc758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.077649 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5afb98-4554-4b27-ad80-9091ae2dc758 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.091376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 897/1802] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:40:40.095786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821f7d-f2e1-408b-92be-53c6a674263c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.106420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821f7d-f2e1-408b-92be-53c6a674263c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.111617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631a51c-962e-4699-94fe-e9aca6895148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.112282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631a51c-962e-4699-94fe-e9aca6895148 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.112564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631a51c-962e-4699-94fe-e9aca6895148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.112838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631a51c-962e-4699-94fe-e9aca6895148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.113515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631a51c-962e-4699-94fe-e9aca6895148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.115429 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631a51c-962e-4699-94fe-e9aca6895148 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.145484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 906/1803] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:40 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:40.150140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5afb98-4554-4b27-ad80-9091ae2dc758 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.160847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5afb98-4554-4b27-ad80-9091ae2dc758 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.251687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137eae-3c9e-4d1a-9aa7-70967151d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.252340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137eae-3c9e-4d1a-9aa7-70967151d9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.252620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137eae-3c9e-4d1a-9aa7-70967151d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.252890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137eae-3c9e-4d1a-9aa7-70967151d9c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.253547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da137eae-3c9e-4d1a-9aa7-70967151d9c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.255470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da137eae-3c9e-4d1a-9aa7-70967151d9c3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.280557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 898/1804] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:40 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:40.281858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631a51c-962e-4699-94fe-e9aca6895148 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.293806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631a51c-962e-4699-94fe-e9aca6895148 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.298467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2515e5-6c4a-48a8-b03e-77a4262cb7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.299179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2515e5-6c4a-48a8-b03e-77a4262cb7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.299942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2515e5-6c4a-48a8-b03e-77a4262cb7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.300309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2515e5-6c4a-48a8-b03e-77a4262cb7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.301020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2515e5-6c4a-48a8-b03e-77a4262cb7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.302610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2515e5-6c4a-48a8-b03e-77a4262cb7f7 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.313017 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 907/1805] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:40.316966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137eae-3c9e-4d1a-9aa7-70967151d9c3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.327270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137eae-3c9e-4d1a-9aa7-70967151d9c3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.331929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c62f1-974e-4f5b-8ae8-3f83d3076967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.332849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c62f1-974e-4f5b-8ae8-3f83d3076967 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.332849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c62f1-974e-4f5b-8ae8-3f83d3076967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.333119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c62f1-974e-4f5b-8ae8-3f83d3076967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.333812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c62f1-974e-4f5b-8ae8-3f83d3076967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.335927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c62f1-974e-4f5b-8ae8-3f83d3076967 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.346917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 899/1806] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:40.350925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2515e5-6c4a-48a8-b03e-77a4262cb7f7 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.360991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2515e5-6c4a-48a8-b03e-77a4262cb7f7 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.366088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7f080-5a9b-4225-8f1d-f21ee01dee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.366792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f080-5a9b-4225-8f1d-f21ee01dee13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.367073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f080-5a9b-4225-8f1d-f21ee01dee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.367345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f080-5a9b-4225-8f1d-f21ee01dee13 admin admin] PATH_INFO: `/v3/projects/ee8cb8b5a75b48f9a4819e91161e9340/users/d158cd75e8514250a5b6a9163b819013/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.378405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:40.385977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7f080-5a9b-4225-8f1d-f21ee01dee13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8cb8b5a75b48f9a4819e91161e9340, user_id=d158cd75e8514250a5b6a9163b819013, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.392463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7f080-5a9b-4225-8f1d-f21ee01dee13 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.408886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 908/1807] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:40 2022] PUT /identity/v3/projects/ee8cb8b5a75b48f9a4819e91161e9340/users/d158cd75e8514250a5b6a9163b819013/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:40.424537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c62f1-974e-4f5b-8ae8-3f83d3076967 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.424537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7e9c62f1-974e-4f5b-8ae8-3f83d3076967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:40.426519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a89be-2b76-4417-bb3d-2743b06f19f4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.426668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a89be-2b76-4417-bb3d-2743b06f19f4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.426932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a89be-2b76-4417-bb3d-2743b06f19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.432950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c62f1-974e-4f5b-8ae8-3f83d3076967 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.461199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-830a89be-2b76-4417-bb3d-2743b06f19f4 None None] MFA Rules not processed for user `d158cd75e8514250a5b6a9163b819013`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:40.462427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-830a89be-2b76-4417-bb3d-2743b06f19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:40.466947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:40.494085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.494729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.495012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.495283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] PATH_INFO: `/v3/projects/aca961c5e4b94e14bab98927de383526` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.496492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca961c5e4b94e14bab98927de383526)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.498497 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.540180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 909/1808] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:40.550958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a89be-2b76-4417-bb3d-2743b06f19f4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.552495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-830a89be-2b76-4417-bb3d-2743b06f19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:40.557457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca961c5e4b94e14bab98927de383526', 'request_id': 'req-760325c1-d0c5-4dc3-8038-42ed50665f8d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.566997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca961c5e4b94e14bab98927de383526', 'request_id': 'req-760325c1-d0c5-4dc3-8038-42ed50665f8d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.576969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca961c5e4b94e14bab98927de383526', 'request_id': 'req-760325c1-d0c5-4dc3-8038-42ed50665f8d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.594709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] The token cache is being invalidate because project aca961c5e4b94e14bab98927de383526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:40.595242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.596092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.598127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 900/1809] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:40 2022] DELETE /identity/v3/projects/aca961c5e4b94e14bab98927de383526 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:40.602045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.603485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:40.619578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a89be-2b76-4417-bb3d-2743b06f19f4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.668488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760325c1-d0c5-4dc3-8038-42ed50665f8d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.670145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.670771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.671055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.671324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.673185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.673829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.674110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:40.674206 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.674392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] PATH_INFO: `/v3/users/40a61d8212234dc1a5cc3c4a5b7a9379` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.675601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a61d8212234dc1a5cc3c4a5b7a9379)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.677558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.725257 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a61d8212234dc1a5cc3c4a5b7a9379'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.726434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:40.732972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a61d8212234dc1a5cc3c4a5b7a9379'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.739440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.740538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a61d8212234dc1a5cc3c4a5b7a9379'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.741068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.741189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a61d8212234dc1a5cc3c4a5b7a9379'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.741753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b61f1c92-44d0-4161-a4fb-12e9340d152c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a61d8212234dc1a5cc3c4a5b7a9379'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.746245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:40.750732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 910/1810] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:40.762718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 901/1811] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:40 2022] DELETE /identity/v3/users/40a61d8212234dc1a5cc3c4a5b7a9379 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:40.773300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:40.775154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:40.789396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfcac6-4b76-4fbb-8cd4-718fecfa0934 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:40.855212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:40.855900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.856210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.856479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] PATH_INFO: `/v3/users/d158cd75e8514250a5b6a9163b819013` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.857661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d158cd75e8514250a5b6a9163b819013)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:40.859602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:40.907795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd158cd75e8514250a5b6a9163b819013'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.922597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd158cd75e8514250a5b6a9163b819013'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.931521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd158cd75e8514250a5b6a9163b819013'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.932324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd158cd75e8514250a5b6a9163b819013'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.932968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd158cd75e8514250a5b6a9163b819013'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:40.946938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 911/1812] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:40 2022] DELETE /identity/v3/users/d158cd75e8514250a5b6a9163b819013 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:40.951648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb6c17-9334-483d-86c9-a231a327a389 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:40.952243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb6c17-9334-483d-86c9-a231a327a389 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:40.952615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb6c17-9334-483d-86c9-a231a327a389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:40.971660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a8cb6c17-9334-483d-86c9-a231a327a389 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:40.972993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a8cb6c17-9334-483d-86c9-a231a327a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:41.046505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 902/1813] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:41.052263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.054544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:41.058517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb6c17-9334-483d-86c9-a231a327a389 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.063304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a8cb6c17-9334-483d-86c9-a231a327a389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:41.068223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e8c6b-4f91-4b1e-a619-6c13d1a04d32 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.075115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.075713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.075996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.076325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] PATH_INFO: `/v3/projects/e008a63f709f492f89ca191d512f36c1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.077510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=e008a63f709f492f89ca191d512f36c1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:41.081891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:41.149775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e008a63f709f492f89ca191d512f36c1', 'request_id': 'req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.157054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb6c17-9334-483d-86c9-a231a327a389 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.157915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e008a63f709f492f89ca191d512f36c1', 'request_id': 'req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.168698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e008a63f709f492f89ca191d512f36c1', 'request_id': 'req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.172952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:41.188322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] The token cache is being invalidate because project e008a63f709f492f89ca191d512f36c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:41.188706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.190169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-abe9a28c-5f3b-4832-a128-4e6bd5a574ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.192683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 912/1814] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:41 2022] DELETE /identity/v3/projects/e008a63f709f492f89ca191d512f36c1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:41.197666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd4b63-45af-46e0-9304-4cb4bbec8668 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.198179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd4b63-45af-46e0-9304-4cb4bbec8668 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.198616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd4b63-45af-46e0-9304-4cb4bbec8668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.229466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-83cd4b63-45af-46e0-9304-4cb4bbec8668 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:41.231226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-83cd4b63-45af-46e0-9304-4cb4bbec8668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:41.243758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd0315-25d1-4a9b-a93d-e94887b6c8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.244471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd0315-25d1-4a9b-a93d-e94887b6c8cc service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.244749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd0315-25d1-4a9b-a93d-e94887b6c8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.245020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd0315-25d1-4a9b-a93d-e94887b6c8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.247029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-14dd0315-25d1-4a9b-a93d-e94887b6c8cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:41.321316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:41.325207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 913/1815] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:41.332925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b633f-5fa5-4fd1-b9ca-eed11d34c63f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.333616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b633f-5fa5-4fd1-b9ca-eed11d34c63f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.333920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b633f-5fa5-4fd1-b9ca-eed11d34c63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.336256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd0315-25d1-4a9b-a93d-e94887b6c8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:41.337965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd0315-25d1-4a9b-a93d-e94887b6c8cc service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:41.348557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 903/1816] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:41.360176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4d5b633f-5fa5-4fd1-b9ca-eed11d34c63f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:41.361379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4d5b633f-5fa5-4fd1-b9ca-eed11d34c63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:41.373123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 914/1817] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:41.374784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd0315-25d1-4a9b-a93d-e94887b6c8cc service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.385433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd0315-25d1-4a9b-a93d-e94887b6c8cc service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.390902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da50f3-d3ab-4b34-bbac-6b9135ffdec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.391440 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da50f3-d3ab-4b34-bbac-6b9135ffdec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.391807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da50f3-d3ab-4b34-bbac-6b9135ffdec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.392082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da50f3-d3ab-4b34-bbac-6b9135ffdec2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.392826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da50f3-d3ab-4b34-bbac-6b9135ffdec2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:41.393182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da50f3-d3ab-4b34-bbac-6b9135ffdec2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:41.394913 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da50f3-d3ab-4b34-bbac-6b9135ffdec2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:41.409484 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 904/1818] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:41.414666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b633f-5fa5-4fd1-b9ca-eed11d34c63f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.424495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b633f-5fa5-4fd1-b9ca-eed11d34c63f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.429760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e44a1-1c00-450e-83f5-653da731be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.430369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e44a1-1c00-450e-83f5-653da731be1a admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.430682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e44a1-1c00-450e-83f5-653da731be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.430920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e44a1-1c00-450e-83f5-653da731be1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.431674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e44a1-1c00-450e-83f5-653da731be1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:41.433747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e44a1-1c00-450e-83f5-653da731be1a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:41.470709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 915/1819] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:41 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:41.475848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da50f3-d3ab-4b34-bbac-6b9135ffdec2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.505794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da50f3-d3ab-4b34-bbac-6b9135ffdec2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.600578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45cc73-42da-4732-bd1b-16ad40ec2642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.601195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45cc73-42da-4732-bd1b-16ad40ec2642 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.601496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45cc73-42da-4732-bd1b-16ad40ec2642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.601956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45cc73-42da-4732-bd1b-16ad40ec2642 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.603455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45cc73-42da-4732-bd1b-16ad40ec2642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:41.605303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae45cc73-42da-4732-bd1b-16ad40ec2642 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:41.638049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 905/1820] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:41 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:41.642146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e44a1-1c00-450e-83f5-653da731be1a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.661979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e44a1-1c00-450e-83f5-653da731be1a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.669053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd0f4c-9f04-4938-abb2-ec111ce6ecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.669886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd0f4c-9f04-4938-abb2-ec111ce6ecd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.670344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd0f4c-9f04-4938-abb2-ec111ce6ecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.670763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd0f4c-9f04-4938-abb2-ec111ce6ecd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.671612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd0f4c-9f04-4938-abb2-ec111ce6ecd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:41.673414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd0f4c-9f04-4938-abb2-ec111ce6ecd5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:41.684775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 916/1821] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:41.688937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45cc73-42da-4732-bd1b-16ad40ec2642 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.699849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae45cc73-42da-4732-bd1b-16ad40ec2642 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.704898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c79df-3ef7-4e7e-b242-5ffac155e588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.705694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c79df-3ef7-4e7e-b242-5ffac155e588 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.705972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c79df-3ef7-4e7e-b242-5ffac155e588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.706245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c79df-3ef7-4e7e-b242-5ffac155e588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.706946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c79df-3ef7-4e7e-b242-5ffac155e588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:41.708613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718c79df-3ef7-4e7e-b242-5ffac155e588 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:41.722954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 906/1822] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:41.728459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd0f4c-9f04-4938-abb2-ec111ce6ecd5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.743439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd0f4c-9f04-4938-abb2-ec111ce6ecd5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.751864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6846a5-1e57-409d-852a-127d0e5ab73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.752672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6846a5-1e57-409d-852a-127d0e5ab73c admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.753074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6846a5-1e57-409d-852a-127d0e5ab73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.753584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6846a5-1e57-409d-852a-127d0e5ab73c admin admin] PATH_INFO: `/v3/projects/e0595114d48c48de843c7b11ce12db01/users/a365807f1946479c89f13e2e44b92093/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.770788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6846a5-1e57-409d-852a-127d0e5ab73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0595114d48c48de843c7b11ce12db01, user_id=a365807f1946479c89f13e2e44b92093, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:41.773605 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6846a5-1e57-409d-852a-127d0e5ab73c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:41.780618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c79df-3ef7-4e7e-b242-5ffac155e588 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.782644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-718c79df-3ef7-4e7e-b242-5ffac155e588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:41.789997 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 917/1823] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:41 2022] PUT /identity/v3/projects/e0595114d48c48de843c7b11ce12db01/users/a365807f1946479c89f13e2e44b92093/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:41.798815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c79df-3ef7-4e7e-b242-5ffac155e588 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.801209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b913-34d0-466a-9301-13156062c41e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.801466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b913-34d0-466a-9301-13156062c41e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.801810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4b913-34d0-466a-9301-13156062c41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.844379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a0f4b913-34d0-466a-9301-13156062c41e None None] MFA Rules not processed for user `a365807f1946479c89f13e2e44b92093`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:41.845993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a0f4b913-34d0-466a-9301-13156062c41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:41.872370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.872937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.873217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.873485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] PATH_INFO: `/v3/projects/ee8cb8b5a75b48f9a4819e91161e9340` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.874668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8cb8b5a75b48f9a4819e91161e9340)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:41.876588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:41.917783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 918/1824] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:41.922431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b913-34d0-466a-9301-13156062c41e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:41.929968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8cb8b5a75b48f9a4819e91161e9340', 'request_id': 'req-8cd8f528-d607-43b5-887c-67ff1fe8fb34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.935087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4b913-34d0-466a-9301-13156062c41e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:41.937608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8cb8b5a75b48f9a4819e91161e9340', 'request_id': 'req-8cd8f528-d607-43b5-887c-67ff1fe8fb34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.940009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:41.947519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8cb8b5a75b48f9a4819e91161e9340', 'request_id': 'req-8cd8f528-d607-43b5-887c-67ff1fe8fb34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.949363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:41.960656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] The token cache is being invalidate because project ee8cb8b5a75b48f9a4819e91161e9340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:41.961026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.961795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8cd8f528-d607-43b5-887c-67ff1fe8fb34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:41.963351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 907/1825] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:41 2022] DELETE /identity/v3/projects/ee8cb8b5a75b48f9a4819e91161e9340 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:41.968276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda85ed1-acec-43f8-b13f-0de6bf9e2b93 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:41.968565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda85ed1-acec-43f8-b13f-0de6bf9e2b93 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:41.968843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda85ed1-acec-43f8-b13f-0de6bf9e2b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:41.991326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dda85ed1-acec-43f8-b13f-0de6bf9e2b93 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:41.992626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dda85ed1-acec-43f8-b13f-0de6bf9e2b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:41.999214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6957e6d-5e08-485a-b0fb-b2e1aaedfd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:41.999834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6957e6d-5e08-485a-b0fb-b2e1aaedfd43 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.000115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6957e6d-5e08-485a-b0fb-b2e1aaedfd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.000428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6957e6d-5e08-485a-b0fb-b2e1aaedfd43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.001087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6957e6d-5e08-485a-b0fb-b2e1aaedfd43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.002987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6957e6d-5e08-485a-b0fb-b2e1aaedfd43 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.030837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 919/1826] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:41 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:42.034835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6957e6d-5e08-485a-b0fb-b2e1aaedfd43 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.036438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e6957e6d-5e08-485a-b0fb-b2e1aaedfd43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:42.056084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 908/1827] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:42.063631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59bf49-4951-4a01-8a78-785ded9eb659 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.063925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59bf49-4951-4a01-8a78-785ded9eb659 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.064234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59bf49-4951-4a01-8a78-785ded9eb659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.084561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fc59bf49-4951-4a01-8a78-785ded9eb659 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:42.085918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fc59bf49-4951-4a01-8a78-785ded9eb659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:42.102037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6957e6d-5e08-485a-b0fb-b2e1aaedfd43 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.106605 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7257cd-722a-48d2-be64-8d217bb84d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.107225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7257cd-722a-48d2-be64-8d217bb84d9a admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.107507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7257cd-722a-48d2-be64-8d217bb84d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.107783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7257cd-722a-48d2-be64-8d217bb84d9a admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.108478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7257cd-722a-48d2-be64-8d217bb84d9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.110404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7257cd-722a-48d2-be64-8d217bb84d9a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.132232 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 920/1828] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:42 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:42.136250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7257cd-722a-48d2-be64-8d217bb84d9a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.145887 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7257cd-722a-48d2-be64-8d217bb84d9a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.149163 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 909/1829] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:42.153480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59bf49-4951-4a01-8a78-785ded9eb659 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.154433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ce1d1-a2b8-4a4a-a8a6-917f6a2b46d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.155105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ce1d1-a2b8-4a4a-a8a6-917f6a2b46d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.155362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ce1d1-a2b8-4a4a-a8a6-917f6a2b46d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.155638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ce1d1-a2b8-4a4a-a8a6-917f6a2b46d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.156404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ce1d1-a2b8-4a4a-a8a6-917f6a2b46d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.158436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ce1d1-a2b8-4a4a-a8a6-917f6a2b46d5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.163764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59bf49-4951-4a01-8a78-785ded9eb659 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.169675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ca8d1-10da-4dde-9742-1563d14fea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.170220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ca8d1-10da-4dde-9742-1563d14fea89 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.170778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ca8d1-10da-4dde-9742-1563d14fea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.171076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ca8d1-10da-4dde-9742-1563d14fea89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.171701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 921/1830] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:42.174824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ca8d1-10da-4dde-9742-1563d14fea89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:42.175145 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ca8d1-10da-4dde-9742-1563d14fea89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.176250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ce1d1-a2b8-4a4a-a8a6-917f6a2b46d5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.176845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ca8d1-10da-4dde-9742-1563d14fea89 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.187943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ce1d1-a2b8-4a4a-a8a6-917f6a2b46d5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.193264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 910/1831] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:42.193395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e148cd-b2a7-4e1a-9dda-332fbd8ba9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.193786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e148cd-b2a7-4e1a-9dda-332fbd8ba9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.194066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e148cd-b2a7-4e1a-9dda-332fbd8ba9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.194336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e148cd-b2a7-4e1a-9dda-332fbd8ba9b3 admin admin] PATH_INFO: `/v3/projects/277f0c5747714c9e8dc7287ccb92aa0a/users/1e662be602234dfda68d39e70e553709/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.195875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ca8d1-10da-4dde-9742-1563d14fea89 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.207072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ca8d1-10da-4dde-9742-1563d14fea89 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.211228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e148cd-b2a7-4e1a-9dda-332fbd8ba9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277f0c5747714c9e8dc7287ccb92aa0a, user_id=1e662be602234dfda68d39e70e553709, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.211648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d53d1-f6bc-43b7-aacb-e591829fd8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.212287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d53d1-f6bc-43b7-aacb-e591829fd8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.212565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d53d1-f6bc-43b7-aacb-e591829fd8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.212840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d53d1-f6bc-43b7-aacb-e591829fd8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.213531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d53d1-f6bc-43b7-aacb-e591829fd8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.215415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d53d1-f6bc-43b7-aacb-e591829fd8d6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.217161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e148cd-b2a7-4e1a-9dda-332fbd8ba9b3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.231359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 922/1832] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:42 2022] PUT /identity/v3/projects/277f0c5747714c9e8dc7287ccb92aa0a/users/1e662be602234dfda68d39e70e553709/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:42.235738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e148cd-b2a7-4e1a-9dda-332fbd8ba9b3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.245458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 911/1833] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:42 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:42.249431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d53d1-f6bc-43b7-aacb-e591829fd8d6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.308413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:42.309954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:42.316036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e148cd-b2a7-4e1a-9dda-332fbd8ba9b3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.321989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2d15b-c39a-4fcd-8642-8631520872f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.322628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2d15b-c39a-4fcd-8642-8631520872f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.322900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2d15b-c39a-4fcd-8642-8631520872f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.323180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2d15b-c39a-4fcd-8642-8631520872f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.323864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2d15b-c39a-4fcd-8642-8631520872f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.325491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2d15b-c39a-4fcd-8642-8631520872f8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.327969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d53d1-f6bc-43b7-aacb-e591829fd8d6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.334567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c905288-85d4-4cbc-9ef9-e7ac9716999a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.335315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c905288-85d4-4cbc-9ef9-e7ac9716999a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.335939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c905288-85d4-4cbc-9ef9-e7ac9716999a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.339139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 923/1834] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:42.339290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c905288-85d4-4cbc-9ef9-e7ac9716999a admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.339290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c905288-85d4-4cbc-9ef9-e7ac9716999a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.340367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c905288-85d4-4cbc-9ef9-e7ac9716999a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.340660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2d15b-c39a-4fcd-8642-8631520872f8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.351487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2d15b-c39a-4fcd-8642-8631520872f8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.365088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4f955-0171-4c86-a167-a3afccd04aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.366977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4f955-0171-4c86-a167-a3afccd04aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.366977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4f955-0171-4c86-a167-a3afccd04aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.368330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4f955-0171-4c86-a167-a3afccd04aa0 admin admin] PATH_INFO: `/v3/projects/277f0c5747714c9e8dc7287ccb92aa0a/users/1e662be602234dfda68d39e70e553709/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.369916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 912/1835] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:42 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:42.371193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4f955-0171-4c86-a167-a3afccd04aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277f0c5747714c9e8dc7287ccb92aa0a, user_id=1e662be602234dfda68d39e70e553709, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.373742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c905288-85d4-4cbc-9ef9-e7ac9716999a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.374499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d4f955-0171-4c86-a167-a3afccd04aa0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.384231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c905288-85d4-4cbc-9ef9-e7ac9716999a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.389379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 924/1836] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:42 2022] PUT /identity/v3/projects/277f0c5747714c9e8dc7287ccb92aa0a/users/1e662be602234dfda68d39e70e553709/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:42.401695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edc515-b7c9-45eb-8a45-22394e3912c1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.402233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edc515-b7c9-45eb-8a45-22394e3912c1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.402509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8edc515-b7c9-45eb-8a45-22394e3912c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.454693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c8edc515-b7c9-45eb-8a45-22394e3912c1 None None] MFA Rules not processed for user `1e662be602234dfda68d39e70e553709`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:42.455975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c8edc515-b7c9-45eb-8a45-22394e3912c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:42.458581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1d9da-dece-408f-86ed-45205911eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.459214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1d9da-dece-408f-86ed-45205911eec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.459528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1d9da-dece-408f-86ed-45205911eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.459934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1d9da-dece-408f-86ed-45205911eec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.460673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1d9da-dece-408f-86ed-45205911eec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.462309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1d9da-dece-408f-86ed-45205911eec4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.472910 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 913/1837] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:42.476972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1d9da-dece-408f-86ed-45205911eec4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.494303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1d9da-dece-408f-86ed-45205911eec4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.499398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab38e5-4b6a-46b8-869e-b1c40cbeebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.500021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab38e5-4b6a-46b8-869e-b1c40cbeebad admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.500343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab38e5-4b6a-46b8-869e-b1c40cbeebad admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.500618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab38e5-4b6a-46b8-869e-b1c40cbeebad admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.501312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab38e5-4b6a-46b8-869e-b1c40cbeebad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.502981 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab38e5-4b6a-46b8-869e-b1c40cbeebad admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.519144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 914/1838] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:42.523092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab38e5-4b6a-46b8-869e-b1c40cbeebad admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.535927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 925/1839] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:42.536082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab38e5-4b6a-46b8-869e-b1c40cbeebad admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.541055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d013646-ef14-4ae6-856b-d140abf146c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.541846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d013646-ef14-4ae6-856b-d140abf146c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.542301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d013646-ef14-4ae6-856b-d140abf146c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.542670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d013646-ef14-4ae6-856b-d140abf146c4 admin admin] PATH_INFO: `/v3/projects/ed1503406be5400fb58e96c71a885111/users/aeb4a5c537b04d0f994b1e4fccabac80/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.543692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edc515-b7c9-45eb-8a45-22394e3912c1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.545433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c8edc515-b7c9-45eb-8a45-22394e3912c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:42.558658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d013646-ef14-4ae6-856b-d140abf146c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1503406be5400fb58e96c71a885111, user_id=aeb4a5c537b04d0f994b1e4fccabac80, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.561329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d013646-ef14-4ae6-856b-d140abf146c4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.577221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 915/1840] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:42 2022] PUT /identity/v3/projects/ed1503406be5400fb58e96c71a885111/users/aeb4a5c537b04d0f994b1e4fccabac80/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:42.588427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cad8d-c013-444d-8f5b-41d2d0872f1a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.588645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cad8d-c013-444d-8f5b-41d2d0872f1a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.588916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cad8d-c013-444d-8f5b-41d2d0872f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.615403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8edc515-b7c9-45eb-8a45-22394e3912c1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.616273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-555cad8d-c013-444d-8f5b-41d2d0872f1a None None] MFA Rules not processed for user `aeb4a5c537b04d0f994b1e4fccabac80`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:42.617529 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-555cad8d-c013-444d-8f5b-41d2d0872f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:42.667708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8854453-8267-469e-ab5a-37acb79b8f10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.668588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854453-8267-469e-ab5a-37acb79b8f10 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.668979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854453-8267-469e-ab5a-37acb79b8f10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.669261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854453-8267-469e-ab5a-37acb79b8f10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.692385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 916/1841] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:42.704995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cad8d-c013-444d-8f5b-41d2d0872f1a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.706384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-555cad8d-c013-444d-8f5b-41d2d0872f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:42.707770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:42.739205 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8854453-8267-469e-ab5a-37acb79b8f10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.742025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8854453-8267-469e-ab5a-37acb79b8f10 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.751440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 926/1842] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:42.752550 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:42.782030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8854453-8267-469e-ab5a-37acb79b8f10 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:42.813525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cad8d-c013-444d-8f5b-41d2d0872f1a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.818034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db15b2-3d16-4ca1-8d9b-406a6d7987b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cd62eb975492aab4a136c0e9825a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.818694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db15b2-3d16-4ca1-8d9b-406a6d7987b0 service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.819038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db15b2-3d16-4ca1-8d9b-406a6d7987b0 service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.819317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db15b2-3d16-4ca1-8d9b-406a6d7987b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.829043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db15b2-3d16-4ca1-8d9b-406a6d7987b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.830585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db15b2-3d16-4ca1-8d9b-406a6d7987b0 service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.842758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 917/1843] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:42.863361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8854453-8267-469e-ab5a-37acb79b8f10 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:42.870457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:42.871122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.871407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.871685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] PATH_INFO: `/v3/users/a365807f1946479c89f13e2e44b92093` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:42.872904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a365807f1946479c89f13e2e44b92093)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:42.875011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:42.931650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a365807f1946479c89f13e2e44b92093'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:42.947115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a365807f1946479c89f13e2e44b92093'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:42.955721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a365807f1946479c89f13e2e44b92093'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:42.956493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a365807f1946479c89f13e2e44b92093'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:42.957115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a365807f1946479c89f13e2e44b92093'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:42.974966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 927/1844] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:42 2022] DELETE /identity/v3/users/a365807f1946479c89f13e2e44b92093 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:42.979939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45bdac-2397-4d6c-a921-570c5347849a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:42.980514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45bdac-2397-4d6c-a921-570c5347849a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:42.980789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45bdac-2397-4d6c-a921-570c5347849a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:43.000485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3c45bdac-2397-4d6c-a921-570c5347849a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:43.002754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3c45bdac-2397-4d6c-a921-570c5347849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:43.068475 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 918/1845] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:43.078289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:43.079858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:43.137783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a118fb-6ae1-4521-bb48-0936e3c63660 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:43.141508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadffc-4a52-4905-bc4f-4723fa8d685b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:43.142124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadffc-4a52-4905-bc4f-4723fa8d685b service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:43.142401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadffc-4a52-4905-bc4f-4723fa8d685b service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:43.142672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbadffc-4a52-4905-bc4f-4723fa8d685b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:43.149255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:43.153187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbadffc-4a52-4905-bc4f-4723fa8d685b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:43.154943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbadffc-4a52-4905-bc4f-4723fa8d685b service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:43.167526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 928/1846] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:43.457082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45bdac-2397-4d6c-a921-570c5347849a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:43.460085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3c45bdac-2397-4d6c-a921-570c5347849a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:43.473914 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45bdac-2397-4d6c-a921-570c5347849a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:43.478896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:43.479739 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:43.480030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:43.480601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] PATH_INFO: `/v3/projects/e0595114d48c48de843c7b11ce12db01` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:43.482206 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0595114d48c48de843c7b11ce12db01)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:43.484752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:43.535456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0595114d48c48de843c7b11ce12db01', 'request_id': 'req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.545528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0595114d48c48de843c7b11ce12db01', 'request_id': 'req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.553030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0595114d48c48de843c7b11ce12db01', 'request_id': 'req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.565400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] The token cache is being invalidate because project e0595114d48c48de843c7b11ce12db01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:43.565918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.566786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.568975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 919/1847] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:43 2022] DELETE /identity/v3/projects/e0595114d48c48de843c7b11ce12db01 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:43.573037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadffc-4a52-4905-bc4f-4723fa8d685b service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:43.589574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbadffc-4a52-4905-bc4f-4723fa8d685b service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:43.674082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:43.674823 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:43.675104 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:43.675378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] PATH_INFO: `/v3/users/1e662be602234dfda68d39e70e553709` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:43.676627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e662be602234dfda68d39e70e553709)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:43.679251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:43.726180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e662be602234dfda68d39e70e553709'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.737746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e662be602234dfda68d39e70e553709'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.745043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e662be602234dfda68d39e70e553709'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.745709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e662be602234dfda68d39e70e553709'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.746330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4a6e68c5-3ec8-4b7e-9aaf-51a2731c6bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e662be602234dfda68d39e70e553709'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:43.758938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 929/1848] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:43 2022] DELETE /identity/v3/users/1e662be602234dfda68d39e70e553709 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:44.111724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:44.113319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:44.134688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938ace5-4c37-4d8e-834d-4cd6f5fa49b2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:44.177016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:44.202448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:44.203096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.203398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.203675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] PATH_INFO: `/v3/projects/277f0c5747714c9e8dc7287ccb92aa0a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.204859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277f0c5747714c9e8dc7287ccb92aa0a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:44.206762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:44.254668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277f0c5747714c9e8dc7287ccb92aa0a', 'request_id': 'req-b9177d80-d297-4f59-931b-24d502255576'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:44.262325 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277f0c5747714c9e8dc7287ccb92aa0a', 'request_id': 'req-b9177d80-d297-4f59-931b-24d502255576'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:44.268586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277f0c5747714c9e8dc7287ccb92aa0a', 'request_id': 'req-b9177d80-d297-4f59-931b-24d502255576'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:44.278879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] The token cache is being invalidate because project 277f0c5747714c9e8dc7287ccb92aa0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:44.279167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:44.279806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b9177d80-d297-4f59-931b-24d502255576 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:44.281456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 920/1849] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:44 2022] DELETE /identity/v3/projects/277f0c5747714c9e8dc7287ccb92aa0a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:44.286371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844bdd-153b-452b-a051-6dd1e52f0946 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.286809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844bdd-153b-452b-a051-6dd1e52f0946 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.286913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f844bdd-153b-452b-a051-6dd1e52f0946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.307186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4f844bdd-153b-452b-a051-6dd1e52f0946 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:44.308437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4f844bdd-153b-452b-a051-6dd1e52f0946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:44.367026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 930/1850] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:44.374804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb5e39-7f72-4300-835b-de67da560bcf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.375088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb5e39-7f72-4300-835b-de67da560bcf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.375360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb5e39-7f72-4300-835b-de67da560bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.394781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ddcb5e39-7f72-4300-835b-de67da560bcf None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:44.395981 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ddcb5e39-7f72-4300-835b-de67da560bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:44.407746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 921/1851] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:44.411605 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844bdd-153b-452b-a051-6dd1e52f0946 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:44.425666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f844bdd-153b-452b-a051-6dd1e52f0946 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:44.432335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ad1c4-b02c-42e8-b724-04d3ade23b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:44.432904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ad1c4-b02c-42e8-b724-04d3ade23b43 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.433186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ad1c4-b02c-42e8-b724-04d3ade23b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.433460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ad1c4-b02c-42e8-b724-04d3ade23b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.434157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ad1c4-b02c-42e8-b724-04d3ade23b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:44.434465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ad1c4-b02c-42e8-b724-04d3ade23b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:44.436120 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ad1c4-b02c-42e8-b724-04d3ade23b43 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:44.444908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:44.452245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 931/1852] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:40:44.453368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb5e39-7f72-4300-835b-de67da560bcf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:44.462566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb5e39-7f72-4300-835b-de67da560bcf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:44.467162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919e250-b782-4224-b33c-e760d3034f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:44.467765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919e250-b782-4224-b33c-e760d3034f7c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.468046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919e250-b782-4224-b33c-e760d3034f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.468348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919e250-b782-4224-b33c-e760d3034f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.469010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919e250-b782-4224-b33c-e760d3034f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:44.470902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919e250-b782-4224-b33c-e760d3034f7c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:44.500152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 922/1853] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:44 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:44.504268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ad1c4-b02c-42e8-b724-04d3ade23b43 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:44.515001 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ad1c4-b02c-42e8-b724-04d3ade23b43 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:44.575659 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a633e0-447e-4233-99e8-e567c26e70fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:44.576182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a633e0-447e-4233-99e8-e567c26e70fb admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.576487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a633e0-447e-4233-99e8-e567c26e70fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.576838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a633e0-447e-4233-99e8-e567c26e70fb admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.577949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a633e0-447e-4233-99e8-e567c26e70fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:44.580410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a633e0-447e-4233-99e8-e567c26e70fb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:44.606771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 932/1854] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:44 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:44.611020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919e250-b782-4224-b33c-e760d3034f7c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:44.622956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919e250-b782-4224-b33c-e760d3034f7c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:44.627594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e9be8-818a-424e-8e95-0a87b423e46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:44.628241 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9be8-818a-424e-8e95-0a87b423e46c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.628523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9be8-818a-424e-8e95-0a87b423e46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.628793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e9be8-818a-424e-8e95-0a87b423e46c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.629528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e9be8-818a-424e-8e95-0a87b423e46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:44.631170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26e9be8-818a-424e-8e95-0a87b423e46c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:44.641607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 923/1855] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:44.645574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a633e0-447e-4233-99e8-e567c26e70fb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:44.658431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a633e0-447e-4233-99e8-e567c26e70fb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:44.665687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb15c4-e160-488c-a2b2-e6b38963393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:44.666338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb15c4-e160-488c-a2b2-e6b38963393c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.666629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb15c4-e160-488c-a2b2-e6b38963393c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.666900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb15c4-e160-488c-a2b2-e6b38963393c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.667688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb15c4-e160-488c-a2b2-e6b38963393c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:44.669394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb15c4-e160-488c-a2b2-e6b38963393c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:44.689617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 933/1856] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:44.693762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e9be8-818a-424e-8e95-0a87b423e46c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:44.705299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e9be8-818a-424e-8e95-0a87b423e46c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:44.710693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a197439-c824-4c28-b1a1-b52d21f0332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:44.711437 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a197439-c824-4c28-b1a1-b52d21f0332f admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.711728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a197439-c824-4c28-b1a1-b52d21f0332f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.712004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a197439-c824-4c28-b1a1-b52d21f0332f admin admin] PATH_INFO: `/v3/projects/d186039338c143ab8771fb7e74f30151/users/2325fd268abf4d8b8e394b0e4cba92ff/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.732448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a197439-c824-4c28-b1a1-b52d21f0332f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d186039338c143ab8771fb7e74f30151, user_id=2325fd268abf4d8b8e394b0e4cba92ff, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:44.735183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a197439-c824-4c28-b1a1-b52d21f0332f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:44.751050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 924/1857] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:44 2022] PUT /identity/v3/projects/d186039338c143ab8771fb7e74f30151/users/2325fd268abf4d8b8e394b0e4cba92ff/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:44.761171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c0878-3b7e-49f8-9537-bf317bfc5c14 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.761474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c0878-3b7e-49f8-9537-bf317bfc5c14 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.761736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c0878-3b7e-49f8-9537-bf317bfc5c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.800618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d47c0878-3b7e-49f8-9537-bf317bfc5c14 None None] MFA Rules not processed for user `2325fd268abf4d8b8e394b0e4cba92ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:44.800618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d47c0878-3b7e-49f8-9537-bf317bfc5c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:44.873016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 934/1858] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:44.877841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a197439-c824-4c28-b1a1-b52d21f0332f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:44.955494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a197439-c824-4c28-b1a1-b52d21f0332f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:44.960727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041edbc-78e9-4f79-bb84-0ce4871e25e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:44.961361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041edbc-78e9-4f79-bb84-0ce4871e25e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:44.961660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041edbc-78e9-4f79-bb84-0ce4871e25e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:44.961920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041edbc-78e9-4f79-bb84-0ce4871e25e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:44.962602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041edbc-78e9-4f79-bb84-0ce4871e25e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:44.964542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041edbc-78e9-4f79-bb84-0ce4871e25e9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:44.976320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:44.995021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 925/1859] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:44 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:44.999212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c0878-3b7e-49f8-9537-bf317bfc5c14 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:45.010848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c0878-3b7e-49f8-9537-bf317bfc5c14 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:45.077515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221826f4-8f30-487f-91d1-24c298ea27ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:45.078254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221826f4-8f30-487f-91d1-24c298ea27ef admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:45.078618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221826f4-8f30-487f-91d1-24c298ea27ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:45.078934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221826f4-8f30-487f-91d1-24c298ea27ef admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:45.079662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221826f4-8f30-487f-91d1-24c298ea27ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:45.081720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221826f4-8f30-487f-91d1-24c298ea27ef admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:45.099102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:45.110317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041edbc-78e9-4f79-bb84-0ce4871e25e9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:45.111255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 935/1860] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:44 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:45.121971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041edbc-78e9-4f79-bb84-0ce4871e25e9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:45.126625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5973b91-51d9-4592-b94a-34efefc28641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:45.127242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5973b91-51d9-4592-b94a-34efefc28641 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:45.127521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5973b91-51d9-4592-b94a-34efefc28641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:45.127794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5973b91-51d9-4592-b94a-34efefc28641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:45.128530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5973b91-51d9-4592-b94a-34efefc28641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:45.130145 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5973b91-51d9-4592-b94a-34efefc28641 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:45.141389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 926/1861] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:45.145879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221826f4-8f30-487f-91d1-24c298ea27ef admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:45.156745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221826f4-8f30-487f-91d1-24c298ea27ef admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:45.161460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55534ca3-ca89-4656-b3a0-51515bdcf7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:45.162149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55534ca3-ca89-4656-b3a0-51515bdcf7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:45.163381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55534ca3-ca89-4656-b3a0-51515bdcf7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:45.163665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55534ca3-ca89-4656-b3a0-51515bdcf7d4 admin admin] PATH_INFO: `/v3/projects/c196be176cf6401a9d0c4a45770a760c/users/ac1a301fb9b84deb92781cf7fe1761cb/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:45.180289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55534ca3-ca89-4656-b3a0-51515bdcf7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c196be176cf6401a9d0c4a45770a760c, user_id=ac1a301fb9b84deb92781cf7fe1761cb, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:45.183249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55534ca3-ca89-4656-b3a0-51515bdcf7d4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:45.198709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 936/1862] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:45 2022] PUT /identity/v3/projects/c196be176cf6401a9d0c4a45770a760c/users/ac1a301fb9b84deb92781cf7fe1761cb/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:45.202999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5973b91-51d9-4592-b94a-34efefc28641 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:45.215147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5973b91-51d9-4592-b94a-34efefc28641 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:45.294887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b0cffe-3155-43ab-9ac0-639906ef92d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:45.295627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0cffe-3155-43ab-9ac0-639906ef92d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:45.296078 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0cffe-3155-43ab-9ac0-639906ef92d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:45.296769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b0cffe-3155-43ab-9ac0-639906ef92d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:45.297135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0cffe-3155-43ab-9ac0-639906ef92d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:45.298761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b0cffe-3155-43ab-9ac0-639906ef92d9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:45.313730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 927/1863] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:45.314865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55534ca3-ca89-4656-b3a0-51515bdcf7d4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:45.327180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55534ca3-ca89-4656-b3a0-51515bdcf7d4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:45.332417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b971b-9b63-452f-ae1c-11b42a86293b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:45.333218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b971b-9b63-452f-ae1c-11b42a86293b admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:45.333552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b971b-9b63-452f-ae1c-11b42a86293b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:45.341234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b971b-9b63-452f-ae1c-11b42a86293b admin admin] PATH_INFO: `/v3/projects/c196be176cf6401a9d0c4a45770a760c/users/ac1a301fb9b84deb92781cf7fe1761cb/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:45.343826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b971b-9b63-452f-ae1c-11b42a86293b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c196be176cf6401a9d0c4a45770a760c, user_id=ac1a301fb9b84deb92781cf7fe1761cb, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:45.347606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b971b-9b63-452f-ae1c-11b42a86293b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:45.360008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 937/1864] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:45 2022] PUT /identity/v3/projects/c196be176cf6401a9d0c4a45770a760c/users/ac1a301fb9b84deb92781cf7fe1761cb/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:45.370988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c09f-3f53-4c3e-8402-5a199755e2f8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:45.371277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c09f-3f53-4c3e-8402-5a199755e2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:45.371552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340c09f-3f53-4c3e-8402-5a199755e2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:45.410993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0340c09f-3f53-4c3e-8402-5a199755e2f8 None None] MFA Rules not processed for user `ac1a301fb9b84deb92781cf7fe1761cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:45.413078 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0340c09f-3f53-4c3e-8402-5a199755e2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:45.499520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 928/1865] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:45.510586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b971b-9b63-452f-ae1c-11b42a86293b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:45.512307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-489b971b-9b63-452f-ae1c-11b42a86293b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:45.570437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b971b-9b63-452f-ae1c-11b42a86293b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:45.574093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea58ed9-fd05-4310-8571-e335e3305b79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:45.574710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea58ed9-fd05-4310-8571-e335e3305b79 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:45.574993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea58ed9-fd05-4310-8571-e335e3305b79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:45.575280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea58ed9-fd05-4310-8571-e335e3305b79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:45.585713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea58ed9-fd05-4310-8571-e335e3305b79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:45.587009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea58ed9-fd05-4310-8571-e335e3305b79 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:45.596754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 938/1866] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:45.699339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340c09f-3f53-4c3e-8402-5a199755e2f8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:45.761973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340c09f-3f53-4c3e-8402-5a199755e2f8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:45.766425 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:45.767066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:45.767348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:45.767623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] PATH_INFO: `/v3/users/2325fd268abf4d8b8e394b0e4cba92ff` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:45.768923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2325fd268abf4d8b8e394b0e4cba92ff)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:45.770941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:45.773256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:45.819058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2325fd268abf4d8b8e394b0e4cba92ff'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:45.826360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2325fd268abf4d8b8e394b0e4cba92ff'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:45.833763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2325fd268abf4d8b8e394b0e4cba92ff'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:45.834598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2325fd268abf4d8b8e394b0e4cba92ff'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:45.835236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2325fd268abf4d8b8e394b0e4cba92ff'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:45.854007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 929/1867] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:45 2022] DELETE /identity/v3/users/2325fd268abf4d8b8e394b0e4cba92ff => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:45.858508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8435d03-bdb8-4d06-b5b9-f91e898e8599 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:45.858796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8435d03-bdb8-4d06-b5b9-f91e898e8599 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:45.859071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8435d03-bdb8-4d06-b5b9-f91e898e8599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:45.879887 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a8435d03-bdb8-4d06-b5b9-f91e898e8599 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:45.881167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a8435d03-bdb8-4d06-b5b9-f91e898e8599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:45.951340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 939/1868] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:45.964847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:45.966392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:46.036693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25ae87d-55ba-4fb5-afbf-f223c1ccd53e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:46.040894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d68b3-2cd4-443f-94ab-9bf5ff0431cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:46.041505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d68b3-2cd4-443f-94ab-9bf5ff0431cb service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:46.041782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d68b3-2cd4-443f-94ab-9bf5ff0431cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:46.042051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d68b3-2cd4-443f-94ab-9bf5ff0431cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:46.051219 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d68b3-2cd4-443f-94ab-9bf5ff0431cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:46.052917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d68b3-2cd4-443f-94ab-9bf5ff0431cb service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:46.066164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 930/1869] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:46.327710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8435d03-bdb8-4d06-b5b9-f91e898e8599 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:46.329266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a8435d03-bdb8-4d06-b5b9-f91e898e8599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:46.342213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8435d03-bdb8-4d06-b5b9-f91e898e8599 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:46.347422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:46.348181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:46.348541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:46.348851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] PATH_INFO: `/v3/projects/d186039338c143ab8771fb7e74f30151` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:46.350668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d186039338c143ab8771fb7e74f30151)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:46.352661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:46.400571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd186039338c143ab8771fb7e74f30151', 'request_id': 'req-52cbee9e-da79-4bce-9b6b-e127701f0130'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.407421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd186039338c143ab8771fb7e74f30151', 'request_id': 'req-52cbee9e-da79-4bce-9b6b-e127701f0130'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.412118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:46.417070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd186039338c143ab8771fb7e74f30151', 'request_id': 'req-52cbee9e-da79-4bce-9b6b-e127701f0130'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.431335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] The token cache is being invalidate because project d186039338c143ab8771fb7e74f30151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:46.431829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.432493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.434267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 940/1870] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:46 2022] DELETE /identity/v3/projects/d186039338c143ab8771fb7e74f30151 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:46.438070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d68b3-2cd4-443f-94ab-9bf5ff0431cb service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:46.449132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d68b3-2cd4-443f-94ab-9bf5ff0431cb service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:46.511977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:46.512835 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:46.513125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:46.513525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] PATH_INFO: `/v3/users/ac1a301fb9b84deb92781cf7fe1761cb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:46.514798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1a301fb9b84deb92781cf7fe1761cb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:46.516853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:46.550754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:46.574130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1a301fb9b84deb92781cf7fe1761cb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.585249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1a301fb9b84deb92781cf7fe1761cb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.594797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1a301fb9b84deb92781cf7fe1761cb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.595544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1a301fb9b84deb92781cf7fe1761cb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.596163 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0bf5cd8a-a590-4cbb-b2dc-3ba762052784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1a301fb9b84deb92781cf7fe1761cb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:46.618806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 931/1871] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:46 2022] DELETE /identity/v3/users/ac1a301fb9b84deb92781cf7fe1761cb => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:46.886511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:46.887970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:46.903082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cbee9e-da79-4bce-9b6b-e127701f0130 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:46.960337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:46.960976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:46.961251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:46.961520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] PATH_INFO: `/v3/projects/c196be176cf6401a9d0c4a45770a760c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:46.962657 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c196be176cf6401a9d0c4a45770a760c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:46.964591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.009567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c196be176cf6401a9d0c4a45770a760c', 'request_id': 'req-ceb3f1bc-d978-43dc-8e01-44e810fab702'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:47.015763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c196be176cf6401a9d0c4a45770a760c', 'request_id': 'req-ceb3f1bc-d978-43dc-8e01-44e810fab702'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:47.024035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c196be176cf6401a9d0c4a45770a760c', 'request_id': 'req-ceb3f1bc-d978-43dc-8e01-44e810fab702'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:47.034543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] The token cache is being invalidate because project c196be176cf6401a9d0c4a45770a760c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:47.034828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:47.035457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ceb3f1bc-d978-43dc-8e01-44e810fab702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:47.037110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 941/1872] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:46 2022] DELETE /identity/v3/projects/c196be176cf6401a9d0c4a45770a760c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:47.042932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412fb66-8eb0-4e8c-86ad-b08e90e19d08 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.043238 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412fb66-8eb0-4e8c-86ad-b08e90e19d08 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.043512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412fb66-8eb0-4e8c-86ad-b08e90e19d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.062906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6412fb66-8eb0-4e8c-86ad-b08e90e19d08 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:47.064010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6412fb66-8eb0-4e8c-86ad-b08e90e19d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:47.131316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 932/1873] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:47.139241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5e56b-59e7-442e-bb08-efa958eb2f1e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.139597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5e56b-59e7-442e-bb08-efa958eb2f1e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.139937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5e56b-59e7-442e-bb08-efa958eb2f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.161917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-45a5e56b-59e7-442e-bb08-efa958eb2f1e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:47.163750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-45a5e56b-59e7-442e-bb08-efa958eb2f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:47.173837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 942/1874] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:47.177790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412fb66-8eb0-4e8c-86ad-b08e90e19d08 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.187148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412fb66-8eb0-4e8c-86ad-b08e90e19d08 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.191640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9387e27-5906-4abd-91f2-b3a8042efb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.192285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9387e27-5906-4abd-91f2-b3a8042efb5e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.192563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9387e27-5906-4abd-91f2-b3a8042efb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.192830 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9387e27-5906-4abd-91f2-b3a8042efb5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.193519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9387e27-5906-4abd-91f2-b3a8042efb5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:47.193816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9387e27-5906-4abd-91f2-b3a8042efb5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.195454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9387e27-5906-4abd-91f2-b3a8042efb5e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.211386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 933/1875] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:47.215855 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5e56b-59e7-442e-bb08-efa958eb2f1e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.226428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5e56b-59e7-442e-bb08-efa958eb2f1e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.231570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b33c-d2bb-45d7-8fef-c2c83dddc9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.232220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b33c-d2bb-45d7-8fef-c2c83dddc9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.232510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b33c-d2bb-45d7-8fef-c2c83dddc9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.232788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b33c-d2bb-45d7-8fef-c2c83dddc9b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.233454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8b33c-d2bb-45d7-8fef-c2c83dddc9b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.235380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8b33c-d2bb-45d7-8fef-c2c83dddc9b9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.263597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 943/1876] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:47 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:47.267827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9387e27-5906-4abd-91f2-b3a8042efb5e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.278692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9387e27-5906-4abd-91f2-b3a8042efb5e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.332496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c41736-0465-475f-87b4-fb2ee6a831b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.333089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c41736-0465-475f-87b4-fb2ee6a831b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.333320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c41736-0465-475f-87b4-fb2ee6a831b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.333613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c41736-0465-475f-87b4-fb2ee6a831b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.334954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c41736-0465-475f-87b4-fb2ee6a831b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.336978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c41736-0465-475f-87b4-fb2ee6a831b6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.357263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 934/1877] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:47 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:47.361630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b33c-d2bb-45d7-8fef-c2c83dddc9b9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.372273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b33c-d2bb-45d7-8fef-c2c83dddc9b9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.378290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994e473-d3b1-47dd-9e97-b863058a852d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.378290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994e473-d3b1-47dd-9e97-b863058a852d admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.378290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994e473-d3b1-47dd-9e97-b863058a852d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.378290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994e473-d3b1-47dd-9e97-b863058a852d admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.378676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994e473-d3b1-47dd-9e97-b863058a852d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.380076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994e473-d3b1-47dd-9e97-b863058a852d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.390622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 944/1878] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:47.394554 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c41736-0465-475f-87b4-fb2ee6a831b6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.405266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c41736-0465-475f-87b4-fb2ee6a831b6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.409738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18a045-10f2-4705-8b49-4777e9387e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.410335 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18a045-10f2-4705-8b49-4777e9387e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.410619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18a045-10f2-4705-8b49-4777e9387e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.410889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18a045-10f2-4705-8b49-4777e9387e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.411578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18a045-10f2-4705-8b49-4777e9387e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.413179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18a045-10f2-4705-8b49-4777e9387e1f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.423598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 935/1879] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:47.427807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994e473-d3b1-47dd-9e97-b863058a852d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.437827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994e473-d3b1-47dd-9e97-b863058a852d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.442493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4c0ba-b8b5-46ec-b744-28c009aee971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.443149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4c0ba-b8b5-46ec-b744-28c009aee971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.443923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4c0ba-b8b5-46ec-b744-28c009aee971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.444241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4c0ba-b8b5-46ec-b744-28c009aee971 admin admin] PATH_INFO: `/v3/projects/a65e87629cb2408e9bf6f7b099f4dc59/users/4086bcb327ea43c2a6717ac347172f63/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.458428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4c0ba-b8b5-46ec-b744-28c009aee971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a65e87629cb2408e9bf6f7b099f4dc59, user_id=4086bcb327ea43c2a6717ac347172f63, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.461792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4c0ba-b8b5-46ec-b744-28c009aee971 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.474389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 945/1880] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:47 2022] PUT /identity/v3/projects/a65e87629cb2408e9bf6f7b099f4dc59/users/4086bcb327ea43c2a6717ac347172f63/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:47.486088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c09a0-bf64-4a36-8419-3e3b28eedd64 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.486587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c09a0-bf64-4a36-8419-3e3b28eedd64 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.486677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c09a0-bf64-4a36-8419-3e3b28eedd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.506699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:47.517286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-909c09a0-bf64-4a36-8419-3e3b28eedd64 None None] MFA Rules not processed for user `4086bcb327ea43c2a6717ac347172f63`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:47.518668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-909c09a0-bf64-4a36-8419-3e3b28eedd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:47.601854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 936/1881] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:47.606210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4c0ba-b8b5-46ec-b744-28c009aee971 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.620407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:47.680114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4c0ba-b8b5-46ec-b744-28c009aee971 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.684865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28c920-30aa-4e9f-8aab-7904ecd78ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.685503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28c920-30aa-4e9f-8aab-7904ecd78ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.685754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28c920-30aa-4e9f-8aab-7904ecd78ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.686084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff28c920-30aa-4e9f-8aab-7904ecd78ab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.686670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28c920-30aa-4e9f-8aab-7904ecd78ab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.688766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff28c920-30aa-4e9f-8aab-7904ecd78ab3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.717393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 946/1882] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:47 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:47.721575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c09a0-bf64-4a36-8419-3e3b28eedd64 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.733819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c09a0-bf64-4a36-8419-3e3b28eedd64 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.794323 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449029ed-43ab-46e5-9fe4-4494aa958293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.794954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449029ed-43ab-46e5-9fe4-4494aa958293 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.795235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449029ed-43ab-46e5-9fe4-4494aa958293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.795505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449029ed-43ab-46e5-9fe4-4494aa958293 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.796289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449029ed-43ab-46e5-9fe4-4494aa958293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.798088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449029ed-43ab-46e5-9fe4-4494aa958293 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.828010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 937/1883] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:47 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:47.832099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28c920-30aa-4e9f-8aab-7904ecd78ab3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.842393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff28c920-30aa-4e9f-8aab-7904ecd78ab3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.846958 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e24db-98fd-4e28-a40d-7fd898e30fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.847565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e24db-98fd-4e28-a40d-7fd898e30fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.847847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e24db-98fd-4e28-a40d-7fd898e30fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.848123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e24db-98fd-4e28-a40d-7fd898e30fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.848842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e24db-98fd-4e28-a40d-7fd898e30fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.850452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e24db-98fd-4e28-a40d-7fd898e30fa1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.860655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 947/1884] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:47.864518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449029ed-43ab-46e5-9fe4-4494aa958293 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.874578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449029ed-43ab-46e5-9fe4-4494aa958293 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.879044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99bd4b-fdb8-483a-8789-68efc4f644d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.879686 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99bd4b-fdb8-483a-8789-68efc4f644d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.879971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99bd4b-fdb8-483a-8789-68efc4f644d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.880273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99bd4b-fdb8-483a-8789-68efc4f644d5 admin admin] PATH_INFO: `/v3/projects/eb1086a1b7b5403eb8bd6cfc2f6c0037/users/93a639778734441e810272015a247fc9/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.894868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99bd4b-fdb8-483a-8789-68efc4f644d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1086a1b7b5403eb8bd6cfc2f6c0037, user_id=93a639778734441e810272015a247fc9, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.897587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99bd4b-fdb8-483a-8789-68efc4f644d5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.910647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 938/1885] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:47 2022] PUT /identity/v3/projects/eb1086a1b7b5403eb8bd6cfc2f6c0037/users/93a639778734441e810272015a247fc9/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:47.914474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e24db-98fd-4e28-a40d-7fd898e30fa1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:47.924551 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e24db-98fd-4e28-a40d-7fd898e30fa1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:47.982761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b754cf-a666-4d05-86a3-70a438f781fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:47.983378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b754cf-a666-4d05-86a3-70a438f781fe admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:47.983660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b754cf-a666-4d05-86a3-70a438f781fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:47.983934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b754cf-a666-4d05-86a3-70a438f781fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:47.984655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b754cf-a666-4d05-86a3-70a438f781fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:47.986250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b754cf-a666-4d05-86a3-70a438f781fe admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:47.996370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 948/1886] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:48.000614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99bd4b-fdb8-483a-8789-68efc4f644d5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:48.011427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99bd4b-fdb8-483a-8789-68efc4f644d5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:48.016110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6178a6-ea13-42c6-bf73-0a14d4f638af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:48.016802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6178a6-ea13-42c6-bf73-0a14d4f638af admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:48.017086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6178a6-ea13-42c6-bf73-0a14d4f638af admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:48.017364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6178a6-ea13-42c6-bf73-0a14d4f638af admin admin] PATH_INFO: `/v3/projects/eb1086a1b7b5403eb8bd6cfc2f6c0037/users/93a639778734441e810272015a247fc9/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:48.019430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6178a6-ea13-42c6-bf73-0a14d4f638af admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb1086a1b7b5403eb8bd6cfc2f6c0037, user_id=93a639778734441e810272015a247fc9, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:48.022127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6178a6-ea13-42c6-bf73-0a14d4f638af admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:48.032376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 939/1887] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:47 2022] PUT /identity/v3/projects/eb1086a1b7b5403eb8bd6cfc2f6c0037/users/93a639778734441e810272015a247fc9/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:48.042657 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6f939-5f0a-40b9-9b3f-f856f301ae8b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:48.042943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6f939-5f0a-40b9-9b3f-f856f301ae8b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:48.043214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6f939-5f0a-40b9-9b3f-f856f301ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:48.070109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-76e6f939-5f0a-40b9-9b3f-f856f301ae8b None None] MFA Rules not processed for user `93a639778734441e810272015a247fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:48.071292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-76e6f939-5f0a-40b9-9b3f-f856f301ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:48.136835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 949/1888] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:48.147530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6178a6-ea13-42c6-bf73-0a14d4f638af admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:48.149217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8b6178a6-ea13-42c6-bf73-0a14d4f638af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:48.215156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6178a6-ea13-42c6-bf73-0a14d4f638af admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:48.218762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29456e37-215a-4f45-9241-dce2267c3299 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:48.219365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29456e37-215a-4f45-9241-dce2267c3299 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:48.219646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29456e37-215a-4f45-9241-dce2267c3299 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:48.219910 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29456e37-215a-4f45-9241-dce2267c3299 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:48.226293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:48.232506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29456e37-215a-4f45-9241-dce2267c3299 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:48.232506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29456e37-215a-4f45-9241-dce2267c3299 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:48.243433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 940/1889] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:48.667845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6f939-5f0a-40b9-9b3f-f856f301ae8b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:48.677236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:48.741511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6f939-5f0a-40b9-9b3f-f856f301ae8b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:48.742411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:48.743065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:48.743375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:48.743651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] PATH_INFO: `/v3/users/4086bcb327ea43c2a6717ac347172f63` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:48.744877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4086bcb327ea43c2a6717ac347172f63)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:48.746813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:48.804871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4086bcb327ea43c2a6717ac347172f63'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:48.822691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4086bcb327ea43c2a6717ac347172f63'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:48.831995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4086bcb327ea43c2a6717ac347172f63'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:48.832776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4086bcb327ea43c2a6717ac347172f63'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:48.833399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4086bcb327ea43c2a6717ac347172f63'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:48.848176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 950/1890] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:48 2022] DELETE /identity/v3/users/4086bcb327ea43c2a6717ac347172f63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:48.851869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2498-e688-4abd-bbf3-8852bf41e85e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:48.852384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2498-e688-4abd-bbf3-8852bf41e85e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:48.853121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b2498-e688-4abd-bbf3-8852bf41e85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:48.871774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-014b2498-e688-4abd-bbf3-8852bf41e85e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:48.873001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-014b2498-e688-4abd-bbf3-8852bf41e85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:48.936418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 941/1891] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:48.942988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:48.944987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:49.007599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a499da-8da6-48c2-b1a8-6cd4efb8f29d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:49.011340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc5b33-606a-4635-a337-da16b9c02dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:49.011965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5b33-606a-4635-a337-da16b9c02dff service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:49.012290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5b33-606a-4635-a337-da16b9c02dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:49.012565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc5b33-606a-4635-a337-da16b9c02dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:49.022390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc5b33-606a-4635-a337-da16b9c02dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:49.023938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdc5b33-606a-4635-a337-da16b9c02dff service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:49.038436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 951/1892] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:49.313524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b2498-e688-4abd-bbf3-8852bf41e85e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:49.315043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-014b2498-e688-4abd-bbf3-8852bf41e85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:49.327931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b2498-e688-4abd-bbf3-8852bf41e85e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:49.332701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:49.333364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:49.333643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:49.333919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] PATH_INFO: `/v3/projects/a65e87629cb2408e9bf6f7b099f4dc59` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:49.335113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a65e87629cb2408e9bf6f7b099f4dc59)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:49.337062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:49.388629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a65e87629cb2408e9bf6f7b099f4dc59', 'request_id': 'req-7ffc5382-6d69-4f02-b34b-3c751ad894a1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.396732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a65e87629cb2408e9bf6f7b099f4dc59', 'request_id': 'req-7ffc5382-6d69-4f02-b34b-3c751ad894a1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.403650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a65e87629cb2408e9bf6f7b099f4dc59', 'request_id': 'req-7ffc5382-6d69-4f02-b34b-3c751ad894a1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.415046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] The token cache is being invalidate because project a65e87629cb2408e9bf6f7b099f4dc59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:49.415416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.416013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.417796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 942/1893] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:49 2022] DELETE /identity/v3/projects/a65e87629cb2408e9bf6f7b099f4dc59 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:49.422427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc5b33-606a-4635-a337-da16b9c02dff service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:49.434541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc5b33-606a-4635-a337-da16b9c02dff service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:49.471991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:49.516863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:49.517522 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:49.517804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:49.518080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] PATH_INFO: `/v3/users/93a639778734441e810272015a247fc9` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:49.519257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=93a639778734441e810272015a247fc9)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:49.521260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:49.578261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93a639778734441e810272015a247fc9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.592404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93a639778734441e810272015a247fc9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.601024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93a639778734441e810272015a247fc9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.601777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93a639778734441e810272015a247fc9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.602412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b9b3d757-2d03-4645-ab15-e87420c18fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93a639778734441e810272015a247fc9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:49.616888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 952/1894] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:49 2022] DELETE /identity/v3/users/93a639778734441e810272015a247fc9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:49.914165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:49.915709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:49.928917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc5382-6d69-4f02-b34b-3c751ad894a1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:50.001102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:50.001881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.002162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.002459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] PATH_INFO: `/v3/projects/eb1086a1b7b5403eb8bd6cfc2f6c0037` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.003665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb1086a1b7b5403eb8bd6cfc2f6c0037)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:50.006040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:50.029873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:50.077009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb1086a1b7b5403eb8bd6cfc2f6c0037', 'request_id': 'req-7bceb9cb-f590-4975-a761-e3f48d8ea37e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:50.089527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb1086a1b7b5403eb8bd6cfc2f6c0037', 'request_id': 'req-7bceb9cb-f590-4975-a761-e3f48d8ea37e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:50.097886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb1086a1b7b5403eb8bd6cfc2f6c0037', 'request_id': 'req-7bceb9cb-f590-4975-a761-e3f48d8ea37e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:50.110947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] The token cache is being invalidate because project eb1086a1b7b5403eb8bd6cfc2f6c0037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:50.110947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:50.111727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7bceb9cb-f590-4975-a761-e3f48d8ea37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:50.116166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 943/1895] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:49 2022] DELETE /identity/v3/projects/eb1086a1b7b5403eb8bd6cfc2f6c0037 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:50.118401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9ef9-4c29-485a-81ba-958bdf28fcb6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.119200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9ef9-4c29-485a-81ba-958bdf28fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.119795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b9ef9-4c29-485a-81ba-958bdf28fcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.148104 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-df5b9ef9-4c29-485a-81ba-958bdf28fcb6 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:50.149979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-df5b9ef9-4c29-485a-81ba-958bdf28fcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:50.223588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 953/1896] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:50.231922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9280350-cd54-4392-a11c-3f5fc5d8079c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.232318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9280350-cd54-4392-a11c-3f5fc5d8079c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.232668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9280350-cd54-4392-a11c-3f5fc5d8079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.252355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d9280350-cd54-4392-a11c-3f5fc5d8079c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:50.253663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d9280350-cd54-4392-a11c-3f5fc5d8079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:50.262082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 944/1897] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:50.266366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b9ef9-4c29-485a-81ba-958bdf28fcb6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:50.278312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b9ef9-4c29-485a-81ba-958bdf28fcb6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:50.282905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1be46a-9ecf-4ee8-83bf-9512a4e04932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:50.283708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1be46a-9ecf-4ee8-83bf-9512a4e04932 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.284013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1be46a-9ecf-4ee8-83bf-9512a4e04932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.284325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1be46a-9ecf-4ee8-83bf-9512a4e04932 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.285027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1be46a-9ecf-4ee8-83bf-9512a4e04932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:50.285328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1be46a-9ecf-4ee8-83bf-9512a4e04932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:50.286913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1be46a-9ecf-4ee8-83bf-9512a4e04932 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:50.298623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 954/1898] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:50.303113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9280350-cd54-4392-a11c-3f5fc5d8079c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:50.312316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9280350-cd54-4392-a11c-3f5fc5d8079c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:50.316925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068541f-0135-4d55-9ae9-f3b36368a86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:50.317537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068541f-0135-4d55-9ae9-f3b36368a86f admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.317816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068541f-0135-4d55-9ae9-f3b36368a86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.318094 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068541f-0135-4d55-9ae9-f3b36368a86f admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.319279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068541f-0135-4d55-9ae9-f3b36368a86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:50.321247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068541f-0135-4d55-9ae9-f3b36368a86f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:50.349024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 945/1899] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:50 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:50.353686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1be46a-9ecf-4ee8-83bf-9512a4e04932 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:50.363875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1be46a-9ecf-4ee8-83bf-9512a4e04932 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:50.403144 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:50.429044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17529d90-021d-458c-9b67-acf7556b7624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:50.429668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17529d90-021d-458c-9b67-acf7556b7624 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.429948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17529d90-021d-458c-9b67-acf7556b7624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.430223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17529d90-021d-458c-9b67-acf7556b7624 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.430892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17529d90-021d-458c-9b67-acf7556b7624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:50.432846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17529d90-021d-458c-9b67-acf7556b7624 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:50.453516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 955/1900] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:50 2022] POST /identity/v3/users => generated 279 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:50.457660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068541f-0135-4d55-9ae9-f3b36368a86f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:50.468184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068541f-0135-4d55-9ae9-f3b36368a86f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:50.472681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029de92-3588-441d-9709-92475c3a942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:50.473315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029de92-3588-441d-9709-92475c3a942f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.473660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029de92-3588-441d-9709-92475c3a942f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.473881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029de92-3588-441d-9709-92475c3a942f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.474610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029de92-3588-441d-9709-92475c3a942f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:50.476203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a029de92-3588-441d-9709-92475c3a942f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:50.486144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 946/1901] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:50.490186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17529d90-021d-458c-9b67-acf7556b7624 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:50.500154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17529d90-021d-458c-9b67-acf7556b7624 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:50.505342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9f926-c1a4-4a1a-a425-6f26f9059359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:50.506587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f926-c1a4-4a1a-a425-6f26f9059359 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.506903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f926-c1a4-4a1a-a425-6f26f9059359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.507178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9f926-c1a4-4a1a-a425-6f26f9059359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.508077 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9f926-c1a4-4a1a-a425-6f26f9059359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:50.509853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e9f926-c1a4-4a1a-a425-6f26f9059359 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:50.521976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 956/1902] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:50.526513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029de92-3588-441d-9709-92475c3a942f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:50.538001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029de92-3588-441d-9709-92475c3a942f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:50.543515 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3ae5c-e629-4ca1-8fd6-14908317f821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:50.544492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ae5c-e629-4ca1-8fd6-14908317f821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.544909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ae5c-e629-4ca1-8fd6-14908317f821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.545319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3ae5c-e629-4ca1-8fd6-14908317f821 admin admin] PATH_INFO: `/v3/projects/ad1f66aea5464a428c30618a94e74c1e/users/32ba8ebd63d349bcb32a52a2ed8d58f7/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.561041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3ae5c-e629-4ca1-8fd6-14908317f821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1f66aea5464a428c30618a94e74c1e, user_id=32ba8ebd63d349bcb32a52a2ed8d58f7, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:50.563811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3ae5c-e629-4ca1-8fd6-14908317f821 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:50.578027 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 947/1903] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:50 2022] PUT /identity/v3/projects/ad1f66aea5464a428c30618a94e74c1e/users/32ba8ebd63d349bcb32a52a2ed8d58f7/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:50.589593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c62e96-e452-4c08-86a2-10d2cb863ea7 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.589882 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c62e96-e452-4c08-86a2-10d2cb863ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.590161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c62e96-e452-4c08-86a2-10d2cb863ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.624284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-97c62e96-e452-4c08-86a2-10d2cb863ea7 None None] MFA Rules not processed for user `32ba8ebd63d349bcb32a52a2ed8d58f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:50.625671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-97c62e96-e452-4c08-86a2-10d2cb863ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:50.725410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 957/1904] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:50.763829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3ae5c-e629-4ca1-8fd6-14908317f821 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:50.776755 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-91a3ae5c-e629-4ca1-8fd6-14908317f821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:50.859388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3ae5c-e629-4ca1-8fd6-14908317f821 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:50.864454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a883bc09-1498-4281-99f5-f1bfe8adeb48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:50.865625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883bc09-1498-4281-99f5-f1bfe8adeb48 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.865909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883bc09-1498-4281-99f5-f1bfe8adeb48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.866177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a883bc09-1498-4281-99f5-f1bfe8adeb48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.875093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883bc09-1498-4281-99f5-f1bfe8adeb48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:50.876687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a883bc09-1498-4281-99f5-f1bfe8adeb48 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:50.885537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 948/1905] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:50.901203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c62e96-e452-4c08-86a2-10d2cb863ea7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:50.983847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c62e96-e452-4c08-86a2-10d2cb863ea7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:50.988681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:50.989417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:50.989782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:50.989961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] PATH_INFO: `/v3/users/32ba8ebd63d349bcb32a52a2ed8d58f7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:50.991291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ba8ebd63d349bcb32a52a2ed8d58f7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:50.993257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:51.058498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ba8ebd63d349bcb32a52a2ed8d58f7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:51.060727 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:51.090500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ba8ebd63d349bcb32a52a2ed8d58f7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:51.103424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ba8ebd63d349bcb32a52a2ed8d58f7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:51.104567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ba8ebd63d349bcb32a52a2ed8d58f7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:51.105670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ba8ebd63d349bcb32a52a2ed8d58f7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:51.140934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 958/1906] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:50 2022] DELETE /identity/v3/users/32ba8ebd63d349bcb32a52a2ed8d58f7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:51.147661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d58bca-7434-42d5-b317-7215a7670100 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:51.148763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d58bca-7434-42d5-b317-7215a7670100 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:51.150263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d58bca-7434-42d5-b317-7215a7670100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:51.183757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c4d58bca-7434-42d5-b317-7215a7670100 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:51.185491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c4d58bca-7434-42d5-b317-7215a7670100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:51.242740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:51.274384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 949/1907] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:51.280845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:51.284558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:51.390261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c41c6e-6b29-4665-ab2d-cca614516894 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:51.395667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0323e-3c97-4159-b915-b23c0e9fc12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:51.397135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0323e-3c97-4159-b915-b23c0e9fc12c service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:51.397423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0323e-3c97-4159-b915-b23c0e9fc12c service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:51.397701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0323e-3c97-4159-b915-b23c0e9fc12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:51.416563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0323e-3c97-4159-b915-b23c0e9fc12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:51.419946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb0323e-3c97-4159-b915-b23c0e9fc12c service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:51.428180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f26e6-8a38-453c-b44a-906cefa98eaf None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:51.428180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f26e6-8a38-453c-b44a-906cefa98eaf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:51.428429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f26e6-8a38-453c-b44a-906cefa98eaf None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:51.432520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 950/1908] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:40:51.443077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a48a7e-3a70-4306-939b-d599ef38bb1d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:51.443443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a48a7e-3a70-4306-939b-d599ef38bb1d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:51.443699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a48a7e-3a70-4306-939b-d599ef38bb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:51.467614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 959/1909] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:51.478742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c7a48a7e-3a70-4306-939b-d599ef38bb1d None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:51.480061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c7a48a7e-3a70-4306-939b-d599ef38bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:51.567293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 951/1910] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:40:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:51.580861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0323e-3c97-4159-b915-b23c0e9fc12c service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:51.582583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bbb0323e-3c97-4159-b915-b23c0e9fc12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:51.599419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0323e-3c97-4159-b915-b23c0e9fc12c service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:51.605525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1377e-3808-4bcd-9a57-02130b21fd67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:51.606148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1377e-3808-4bcd-9a57-02130b21fd67 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:51.606438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1377e-3808-4bcd-9a57-02130b21fd67 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:51.606712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1377e-3808-4bcd-9a57-02130b21fd67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:51.616003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1377e-3808-4bcd-9a57-02130b21fd67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:51.617667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1377e-3808-4bcd-9a57-02130b21fd67 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:51.629058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 960/1911] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:51.986788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a48a7e-3a70-4306-939b-d599ef38bb1d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:51.988479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c7a48a7e-3a70-4306-939b-d599ef38bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:52.006336 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a48a7e-3a70-4306-939b-d599ef38bb1d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:52.017963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:52.018690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.019043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.019381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] PATH_INFO: `/v3/projects/ad1f66aea5464a428c30618a94e74c1e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.020640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1f66aea5464a428c30618a94e74c1e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:52.023495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:52.070652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1f66aea5464a428c30618a94e74c1e', 'request_id': 'req-d12afe0e-6305-47b6-9002-1eeff42c9fb3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:52.077887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1f66aea5464a428c30618a94e74c1e', 'request_id': 'req-d12afe0e-6305-47b6-9002-1eeff42c9fb3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:52.085331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1f66aea5464a428c30618a94e74c1e', 'request_id': 'req-d12afe0e-6305-47b6-9002-1eeff42c9fb3'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:52.095972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] The token cache is being invalidate because project ad1f66aea5464a428c30618a94e74c1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:52.096296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:52.096940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d12afe0e-6305-47b6-9002-1eeff42c9fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:52.098461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 952/1912] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:51 2022] DELETE /identity/v3/projects/ad1f66aea5464a428c30618a94e74c1e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:52.103390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664e11-4abb-456d-a896-de60be02b69f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.103682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664e11-4abb-456d-a896-de60be02b69f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.103955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59664e11-4abb-456d-a896-de60be02b69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.123399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-59664e11-4abb-456d-a896-de60be02b69f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:52.124622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-59664e11-4abb-456d-a896-de60be02b69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:52.183169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 961/1913] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:52.190962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752aa17-92f7-4545-856f-e641b5e16be0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.191365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752aa17-92f7-4545-856f-e641b5e16be0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.191512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752aa17-92f7-4545-856f-e641b5e16be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.211735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f752aa17-92f7-4545-856f-e641b5e16be0 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:52.213001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f752aa17-92f7-4545-856f-e641b5e16be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:52.220663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 953/1914] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:52.224764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664e11-4abb-456d-a896-de60be02b69f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:52.235123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59664e11-4abb-456d-a896-de60be02b69f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:52.239826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2240686-c09a-4021-9fae-26cc00c50523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:52.240993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2240686-c09a-4021-9fae-26cc00c50523 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.241276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2240686-c09a-4021-9fae-26cc00c50523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.241572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2240686-c09a-4021-9fae-26cc00c50523 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.242334 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2240686-c09a-4021-9fae-26cc00c50523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:52.242656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2240686-c09a-4021-9fae-26cc00c50523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:52.244310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2240686-c09a-4021-9fae-26cc00c50523 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:52.256885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 962/1915] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:52.261190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752aa17-92f7-4545-856f-e641b5e16be0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:52.270711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752aa17-92f7-4545-856f-e641b5e16be0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:52.276103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2379b6-0101-4b39-b1ad-1f4f4f741a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:52.276732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2379b6-0101-4b39-b1ad-1f4f4f741a02 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.277294 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2379b6-0101-4b39-b1ad-1f4f4f741a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.277642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2379b6-0101-4b39-b1ad-1f4f4f741a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.278434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2379b6-0101-4b39-b1ad-1f4f4f741a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:52.280368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2379b6-0101-4b39-b1ad-1f4f4f741a02 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:52.307672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 954/1916] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:52 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:52.312167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2240686-c09a-4021-9fae-26cc00c50523 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:52.323438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2240686-c09a-4021-9fae-26cc00c50523 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:52.364216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:52.388752 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb52e7-18f0-4711-b458-4ad00f4ec5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:52.389372 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb52e7-18f0-4711-b458-4ad00f4ec5df admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.389689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb52e7-18f0-4711-b458-4ad00f4ec5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.389962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb52e7-18f0-4711-b458-4ad00f4ec5df admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.390652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb52e7-18f0-4711-b458-4ad00f4ec5df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:52.392623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eb52e7-18f0-4711-b458-4ad00f4ec5df admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:52.416166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 963/1917] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:52 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:52.418753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2379b6-0101-4b39-b1ad-1f4f4f741a02 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:52.430237 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2379b6-0101-4b39-b1ad-1f4f4f741a02 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:52.434811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106def8-3b63-4e8c-ba34-cc72fbddba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:52.435419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106def8-3b63-4e8c-ba34-cc72fbddba20 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.435746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106def8-3b63-4e8c-ba34-cc72fbddba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.436024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106def8-3b63-4e8c-ba34-cc72fbddba20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.436762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106def8-3b63-4e8c-ba34-cc72fbddba20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:52.438705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106def8-3b63-4e8c-ba34-cc72fbddba20 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:52.451050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 955/1918] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:52.455154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb52e7-18f0-4711-b458-4ad00f4ec5df admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:52.469162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb52e7-18f0-4711-b458-4ad00f4ec5df admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:52.475851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7e88f-14c3-4fc2-a3a0-a4793d12e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:52.476508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e88f-14c3-4fc2-a3a0-a4793d12e6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.476844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e88f-14c3-4fc2-a3a0-a4793d12e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.477137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7e88f-14c3-4fc2-a3a0-a4793d12e6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.477829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7e88f-14c3-4fc2-a3a0-a4793d12e6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:52.479974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7e88f-14c3-4fc2-a3a0-a4793d12e6c2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:52.493407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 964/1919] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:52.497690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106def8-3b63-4e8c-ba34-cc72fbddba20 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:52.508462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106def8-3b63-4e8c-ba34-cc72fbddba20 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:52.514702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd26f-6531-4f52-86c1-3b3eba0d80c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:52.515412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd26f-6531-4f52-86c1-3b3eba0d80c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.515758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd26f-6531-4f52-86c1-3b3eba0d80c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.515953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dd26f-6531-4f52-86c1-3b3eba0d80c5 admin admin] PATH_INFO: `/v3/projects/3c250ef732744ffebbe4e136eaa4f488/users/6a8544a75f3f433584cda3bd5ce06838/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.544638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd26f-6531-4f52-86c1-3b3eba0d80c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c250ef732744ffebbe4e136eaa4f488, user_id=6a8544a75f3f433584cda3bd5ce06838, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:52.547303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191dd26f-6531-4f52-86c1-3b3eba0d80c5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:52.560359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:52.574223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 956/1920] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:52 2022] PUT /identity/v3/projects/3c250ef732744ffebbe4e136eaa4f488/users/6a8544a75f3f433584cda3bd5ce06838/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:52.585417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704f06-b61f-4823-937d-b1c694a021c4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.585733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704f06-b61f-4823-937d-b1c694a021c4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.586049 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704f06-b61f-4823-937d-b1c694a021c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.617986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-82704f06-b61f-4823-937d-b1c694a021c4 None None] MFA Rules not processed for user `6a8544a75f3f433584cda3bd5ce06838`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:52.619495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-82704f06-b61f-4823-937d-b1c694a021c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:52.720422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 965/1921] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:52.721684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd26f-6531-4f52-86c1-3b3eba0d80c5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:52.822251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191dd26f-6531-4f52-86c1-3b3eba0d80c5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:52.828306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc4f6-11a3-4e95-9dbc-b16f09cbf3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:52.828926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc4f6-11a3-4e95-9dbc-b16f09cbf3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.829233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc4f6-11a3-4e95-9dbc-b16f09cbf3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.829602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc4f6-11a3-4e95-9dbc-b16f09cbf3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.830454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc4f6-11a3-4e95-9dbc-b16f09cbf3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:52.832602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc4f6-11a3-4e95-9dbc-b16f09cbf3b5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:52.876441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 957/1922] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:52 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:52.879689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82704f06-b61f-4823-937d-b1c694a021c4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:52.891068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82704f06-b61f-4823-937d-b1c694a021c4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:52.958414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9475d6f-31c7-4a47-a615-62c77fa7eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:52.959575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9475d6f-31c7-4a47-a615-62c77fa7eb60 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:52.959866 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9475d6f-31c7-4a47-a615-62c77fa7eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:52.960171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9475d6f-31c7-4a47-a615-62c77fa7eb60 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:52.960839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9475d6f-31c7-4a47-a615-62c77fa7eb60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:52.962760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9475d6f-31c7-4a47-a615-62c77fa7eb60 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:52.986356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 966/1923] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:52 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:52.990634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc4f6-11a3-4e95-9dbc-b16f09cbf3b5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:53.001018 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc4f6-11a3-4e95-9dbc-b16f09cbf3b5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:53.006526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269210e-2df1-47a2-a5bc-85ea9ed71a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:53.007157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269210e-2df1-47a2-a5bc-85ea9ed71a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:53.007430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269210e-2df1-47a2-a5bc-85ea9ed71a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:53.007725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8269210e-2df1-47a2-a5bc-85ea9ed71a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:53.008456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269210e-2df1-47a2-a5bc-85ea9ed71a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:53.010038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8269210e-2df1-47a2-a5bc-85ea9ed71a94 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:53.021897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 958/1924] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:53.026500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9475d6f-31c7-4a47-a615-62c77fa7eb60 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:53.041012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9475d6f-31c7-4a47-a615-62c77fa7eb60 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:53.046499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2f65b-1477-4edd-ab50-629f1b28a26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:53.047064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f65b-1477-4edd-ab50-629f1b28a26e admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:53.047444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f65b-1477-4edd-ab50-629f1b28a26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:53.048251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2f65b-1477-4edd-ab50-629f1b28a26e admin admin] PATH_INFO: `/v3/projects/8547d6d1fcbc4c989d37d8be7f92bf46/users/02f3816c2e3c46809112bb7a65db1baa/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:53.065426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2f65b-1477-4edd-ab50-629f1b28a26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8547d6d1fcbc4c989d37d8be7f92bf46, user_id=02f3816c2e3c46809112bb7a65db1baa, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:53.068260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2f65b-1477-4edd-ab50-629f1b28a26e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:53.086371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 967/1925] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:53 2022] PUT /identity/v3/projects/8547d6d1fcbc4c989d37d8be7f92bf46/users/02f3816c2e3c46809112bb7a65db1baa/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:53.090789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269210e-2df1-47a2-a5bc-85ea9ed71a94 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:53.107647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8269210e-2df1-47a2-a5bc-85ea9ed71a94 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:53.203822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89d829-9eb2-49e5-b3f9-ff39a581a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:53.204509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89d829-9eb2-49e5-b3f9-ff39a581a67c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:53.204768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89d829-9eb2-49e5-b3f9-ff39a581a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:53.205042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89d829-9eb2-49e5-b3f9-ff39a581a67c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:53.205753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89d829-9eb2-49e5-b3f9-ff39a581a67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:53.207362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89d829-9eb2-49e5-b3f9-ff39a581a67c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:53.222295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 959/1926] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:53 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:53.223481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2f65b-1477-4edd-ab50-629f1b28a26e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:53.236847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2f65b-1477-4edd-ab50-629f1b28a26e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:53.242139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545bd64-c832-48df-85e1-1c140587949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:53.242900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545bd64-c832-48df-85e1-1c140587949f admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:53.243182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545bd64-c832-48df-85e1-1c140587949f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:53.243461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545bd64-c832-48df-85e1-1c140587949f admin admin] PATH_INFO: `/v3/projects/8547d6d1fcbc4c989d37d8be7f92bf46/users/02f3816c2e3c46809112bb7a65db1baa/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:53.245497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545bd64-c832-48df-85e1-1c140587949f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8547d6d1fcbc4c989d37d8be7f92bf46, user_id=02f3816c2e3c46809112bb7a65db1baa, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:53.248182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545bd64-c832-48df-85e1-1c140587949f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:53.260877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 968/1927] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:53 2022] PUT /identity/v3/projects/8547d6d1fcbc4c989d37d8be7f92bf46/users/02f3816c2e3c46809112bb7a65db1baa/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:53.272777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230f38-76c6-47c7-b6fb-021adc17dcf9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:53.273226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230f38-76c6-47c7-b6fb-021adc17dcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:53.273693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f230f38-76c6-47c7-b6fb-021adc17dcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:53.305687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1f230f38-76c6-47c7-b6fb-021adc17dcf9 None None] MFA Rules not processed for user `02f3816c2e3c46809112bb7a65db1baa`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:53.307050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1f230f38-76c6-47c7-b6fb-021adc17dcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:53.373670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:53.385527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 960/1928] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:53.396244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545bd64-c832-48df-85e1-1c140587949f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:53.398877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6545bd64-c832-48df-85e1-1c140587949f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:53.405204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:53.459583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545bd64-c832-48df-85e1-1c140587949f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:53.463168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d61e95-1d50-4bd2-9ed5-b9677b78b977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:53.463793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d61e95-1d50-4bd2-9ed5-b9677b78b977 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:53.464075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d61e95-1d50-4bd2-9ed5-b9677b78b977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:53.464495 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d61e95-1d50-4bd2-9ed5-b9677b78b977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:53.520650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d61e95-1d50-4bd2-9ed5-b9677b78b977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:53.522387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d61e95-1d50-4bd2-9ed5-b9677b78b977 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:53.532859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 969/1929] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:53.986462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230f38-76c6-47c7-b6fb-021adc17dcf9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:53.988034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1f230f38-76c6-47c7-b6fb-021adc17dcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:54.074162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f230f38-76c6-47c7-b6fb-021adc17dcf9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:54.078862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:54.079506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:54.079792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:54.080068 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] PATH_INFO: `/v3/users/c609e8a74a7948b798a14697f3644bfc` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:54.081280 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c609e8a74a7948b798a14697f3644bfc)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:54.083202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:54.154322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c609e8a74a7948b798a14697f3644bfc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.164177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c609e8a74a7948b798a14697f3644bfc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.176155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c609e8a74a7948b798a14697f3644bfc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.177110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c609e8a74a7948b798a14697f3644bfc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.178624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c609e8a74a7948b798a14697f3644bfc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.199080 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 961/1930] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:53 2022] DELETE /identity/v3/users/c609e8a74a7948b798a14697f3644bfc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:54.203821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65a82-53fd-4fc3-9e40-77e38c362697 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:54.204358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65a82-53fd-4fc3-9e40-77e38c362697 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:54.204526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf65a82-53fd-4fc3-9e40-77e38c362697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:54.226406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0cf65a82-53fd-4fc3-9e40-77e38c362697 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:54.227720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0cf65a82-53fd-4fc3-9e40-77e38c362697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:54.332271 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 970/1931] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:54.339729 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:54.341638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:54.423912 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac32d11-f566-4b36-8d13-b9b35d7b417e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:54.428816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cb46f-c463-4924-9f96-d2ec8a4c4bc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:54.429700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cb46f-c463-4924-9f96-d2ec8a4c4bc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:54.430216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cb46f-c463-4924-9f96-d2ec8a4c4bc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:54.430541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621cb46f-c463-4924-9f96-d2ec8a4c4bc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:54.440911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cb46f-c463-4924-9f96-d2ec8a4c4bc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:54.442388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621cb46f-c463-4924-9f96-d2ec8a4c4bc5 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:54.453118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 962/1932] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:54.738980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf65a82-53fd-4fc3-9e40-77e38c362697 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:54.741852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0cf65a82-53fd-4fc3-9e40-77e38c362697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:54.755426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf65a82-53fd-4fc3-9e40-77e38c362697 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:54.760875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:54.761561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:54.761852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:54.762169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] PATH_INFO: `/v3/projects/ec2bfc9a02674c2da7292319b62d536a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:54.763485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2bfc9a02674c2da7292319b62d536a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:54.768818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:54.829515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2bfc9a02674c2da7292319b62d536a', 'request_id': 'req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.831380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:54.837365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2bfc9a02674c2da7292319b62d536a', 'request_id': 'req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.848367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2bfc9a02674c2da7292319b62d536a', 'request_id': 'req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.862246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] The token cache is being invalidate because project ec2bfc9a02674c2da7292319b62d536a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:54.862589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.863298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:54.865915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 971/1933] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:54 2022] DELETE /identity/v3/projects/ec2bfc9a02674c2da7292319b62d536a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:54.870654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cb46f-c463-4924-9f96-d2ec8a4c4bc5 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:54.885779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621cb46f-c463-4924-9f96-d2ec8a4c4bc5 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:54.903898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:55.037701 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.038692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.038885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.039158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] PATH_INFO: `/v3/users/16bbc1fc83814253ac5fc6f216cece0c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.041477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=16bbc1fc83814253ac5fc6f216cece0c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.045854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.168590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16bbc1fc83814253ac5fc6f216cece0c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:55.179776 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16bbc1fc83814253ac5fc6f216cece0c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:55.207561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16bbc1fc83814253ac5fc6f216cece0c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:55.209175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16bbc1fc83814253ac5fc6f216cece0c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:55.216478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-40041b3c-e0c9-48af-b0ee-f4e2d90b88ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16bbc1fc83814253ac5fc6f216cece0c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:55.251148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 963/1934] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:54 2022] DELETE /identity/v3/users/16bbc1fc83814253ac5fc6f216cece0c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:55.870452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.872015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.886496 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17cd38-61f3-407d-aa13-7b3ecf050b5c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.944158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.945410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.945692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.945965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] PATH_INFO: `/v3/projects/cb5ca3a743e44f30a059f722e9d850b0` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.947879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb5ca3a743e44f30a059f722e9d850b0)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.949909 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.000639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb5ca3a743e44f30a059f722e9d850b0', 'request_id': 'req-15d2a0c0-9d28-4388-8c92-fd754cc41043'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.007754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb5ca3a743e44f30a059f722e9d850b0', 'request_id': 'req-15d2a0c0-9d28-4388-8c92-fd754cc41043'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.016212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb5ca3a743e44f30a059f722e9d850b0', 'request_id': 'req-15d2a0c0-9d28-4388-8c92-fd754cc41043'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.032486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] The token cache is being invalidate because project cb5ca3a743e44f30a059f722e9d850b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:56.032836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.033491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-15d2a0c0-9d28-4388-8c92-fd754cc41043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.035006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 972/1935] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:55 2022] DELETE /identity/v3/projects/cb5ca3a743e44f30a059f722e9d850b0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:56.039839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88502e1d-5c11-4987-ad8b-5f625158e1e5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.040333 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88502e1d-5c11-4987-ad8b-5f625158e1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.040445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88502e1d-5c11-4987-ad8b-5f625158e1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.062441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-88502e1d-5c11-4987-ad8b-5f625158e1e5 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:56.062872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-88502e1d-5c11-4987-ad8b-5f625158e1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:56.127212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 964/1936] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:56.135959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5345-9dcb-4047-bba6-cfd2c2d6180a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.136304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5345-9dcb-4047-bba6-cfd2c2d6180a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.136552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d5345-9dcb-4047-bba6-cfd2c2d6180a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.157500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c31d5345-9dcb-4047-bba6-cfd2c2d6180a None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:56.158944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c31d5345-9dcb-4047-bba6-cfd2c2d6180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:56.169321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 973/1937] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:56.171619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88502e1d-5c11-4987-ad8b-5f625158e1e5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.181919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88502e1d-5c11-4987-ad8b-5f625158e1e5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.187481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b7c1-ead3-49e4-8c83-9aa8fe14cb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.188719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b7c1-ead3-49e4-8c83-9aa8fe14cb4a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.189317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b7c1-ead3-49e4-8c83-9aa8fe14cb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.189906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8b7c1-ead3-49e4-8c83-9aa8fe14cb4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.190818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b7c1-ead3-49e4-8c83-9aa8fe14cb4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:56.191134 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b7c1-ead3-49e4-8c83-9aa8fe14cb4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.193715 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8b7c1-ead3-49e4-8c83-9aa8fe14cb4a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.206219 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 965/1938] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:56.210629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d5345-9dcb-4047-bba6-cfd2c2d6180a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.219895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d5345-9dcb-4047-bba6-cfd2c2d6180a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.224601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac7033-5e59-413f-b0cf-8f8456d4919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.225218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac7033-5e59-413f-b0cf-8f8456d4919f admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.225516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac7033-5e59-413f-b0cf-8f8456d4919f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.225772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac7033-5e59-413f-b0cf-8f8456d4919f admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.226519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac7033-5e59-413f-b0cf-8f8456d4919f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.228466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac7033-5e59-413f-b0cf-8f8456d4919f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.259448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 974/1939] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.260859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b7c1-ead3-49e4-8c83-9aa8fe14cb4a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.271100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8b7c1-ead3-49e4-8c83-9aa8fe14cb4a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.294504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac7033-5e59-413f-b0cf-8f8456d4919f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.295212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:56.296788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6aac7033-5e59-413f-b0cf-8f8456d4919f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:56.335626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf1327-cae1-4a99-bf76-ca04c86854af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.336287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf1327-cae1-4a99-bf76-ca04c86854af admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.336571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf1327-cae1-4a99-bf76-ca04c86854af admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.336841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf1327-cae1-4a99-bf76-ca04c86854af admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.337530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf1327-cae1-4a99-bf76-ca04c86854af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.339434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf1327-cae1-4a99-bf76-ca04c86854af admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.342061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:56.361983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 966/1940] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.363766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac7033-5e59-413f-b0cf-8f8456d4919f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.365859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf1327-cae1-4a99-bf76-ca04c86854af admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.368441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.369080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.369356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.369626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] PATH_INFO: `/v3/users/6a8544a75f3f433584cda3bd5ce06838` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.370785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8544a75f3f433584cda3bd5ce06838)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.372754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.376162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf1327-cae1-4a99-bf76-ca04c86854af admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.381283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90b3f-e86b-4be3-8515-62a94717caff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.381876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90b3f-e86b-4be3-8515-62a94717caff admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.382156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90b3f-e86b-4be3-8515-62a94717caff admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.382429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad90b3f-e86b-4be3-8515-62a94717caff admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.383119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90b3f-e86b-4be3-8515-62a94717caff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.384713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad90b3f-e86b-4be3-8515-62a94717caff admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.395138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 967/1941] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:56.400278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90b3f-e86b-4be3-8515-62a94717caff admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.410711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad90b3f-e86b-4be3-8515-62a94717caff admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.415463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f15100-e07c-4162-9ac2-636c5e2c1327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.416059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f15100-e07c-4162-9ac2-636c5e2c1327 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.416368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f15100-e07c-4162-9ac2-636c5e2c1327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.416642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f15100-e07c-4162-9ac2-636c5e2c1327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.417358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f15100-e07c-4162-9ac2-636c5e2c1327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.418943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f15100-e07c-4162-9ac2-636c5e2c1327 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.427052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8544a75f3f433584cda3bd5ce06838'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.428967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 968/1942] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:56.433321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f15100-e07c-4162-9ac2-636c5e2c1327 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.442722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f15100-e07c-4162-9ac2-636c5e2c1327 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.443439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8544a75f3f433584cda3bd5ce06838'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.447873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75208bb9-1356-48ae-b066-5584b98aecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.448537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75208bb9-1356-48ae-b066-5584b98aecbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.448815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75208bb9-1356-48ae-b066-5584b98aecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.449093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75208bb9-1356-48ae-b066-5584b98aecbc admin admin] PATH_INFO: `/v3/projects/3e7b96cacb1441b08f120b4ce0085c4e/users/544c64f22f8140cf8b92207e7eb41d9a/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.450778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8544a75f3f433584cda3bd5ce06838'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.451514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8544a75f3f433584cda3bd5ce06838'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.452256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6dde6c7d-6cc3-4746-acb3-62bbb9d89777 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8544a75f3f433584cda3bd5ce06838'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:56.466626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75208bb9-1356-48ae-b066-5584b98aecbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e7b96cacb1441b08f120b4ce0085c4e, user_id=544c64f22f8140cf8b92207e7eb41d9a, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.467648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 975/1943] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:56 2022] DELETE /identity/v3/users/6a8544a75f3f433584cda3bd5ce06838 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:56.469467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75208bb9-1356-48ae-b066-5584b98aecbc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.472019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bfbc7-b309-40c9-8b93-14dfbdd8c962 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.472462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bfbc7-b309-40c9-8b93-14dfbdd8c962 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.473094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752bfbc7-b309-40c9-8b93-14dfbdd8c962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.486896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 969/1944] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:56 2022] PUT /identity/v3/projects/3e7b96cacb1441b08f120b4ce0085c4e/users/544c64f22f8140cf8b92207e7eb41d9a/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:56.497993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99065af5-380a-4d8e-b52a-4b450f28a4e3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.498285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99065af5-380a-4d8e-b52a-4b450f28a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.498562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99065af5-380a-4d8e-b52a-4b450f28a4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.501013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-752bfbc7-b309-40c9-8b93-14dfbdd8c962 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:56.502455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-752bfbc7-b309-40c9-8b93-14dfbdd8c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:56.533838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-99065af5-380a-4d8e-b52a-4b450f28a4e3 None None] MFA Rules not processed for user `544c64f22f8140cf8b92207e7eb41d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:56.535070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-99065af5-380a-4d8e-b52a-4b450f28a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:56.597347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 976/1945] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:56.608835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bfbc7-b309-40c9-8b93-14dfbdd8c962 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.610723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-752bfbc7-b309-40c9-8b93-14dfbdd8c962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:56.629458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 970/1946] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:56.635464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99065af5-380a-4d8e-b52a-4b450f28a4e3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.637143 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-99065af5-380a-4d8e-b52a-4b450f28a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:56.675348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99065af5-380a-4d8e-b52a-4b450f28a4e3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.680831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aca08-f321-472f-9291-81706487a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.681395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aca08-f321-472f-9291-81706487a442 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.681703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aca08-f321-472f-9291-81706487a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.681980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aca08-f321-472f-9291-81706487a442 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.682652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10aca08-f321-472f-9291-81706487a442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.685973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10aca08-f321-472f-9291-81706487a442 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.713794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752bfbc7-b309-40c9-8b93-14dfbdd8c962 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.717942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2b5d4-3f3a-4afe-8546-fbf7a9a4af69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.718576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2b5d4-3f3a-4afe-8546-fbf7a9a4af69 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.718858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2b5d4-3f3a-4afe-8546-fbf7a9a4af69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.719134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2b5d4-3f3a-4afe-8546-fbf7a9a4af69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.720176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 971/1947] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:56.723871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aca08-f321-472f-9291-81706487a442 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.735370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2b5d4-3f3a-4afe-8546-fbf7a9a4af69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.736868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2b5d4-3f3a-4afe-8546-fbf7a9a4af69 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.749426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 977/1948] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:56.769588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:56.801658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aca08-f321-472f-9291-81706487a442 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.807405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f928b-985c-4c1c-beb0-753de491e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.808056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f928b-985c-4c1c-beb0-753de491e425 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.808364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f928b-985c-4c1c-beb0-753de491e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.808637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f928b-985c-4c1c-beb0-753de491e425 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.809790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f928b-985c-4c1c-beb0-753de491e425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.811335 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f928b-985c-4c1c-beb0-753de491e425 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.846447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 972/1949] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:56.850439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2b5d4-3f3a-4afe-8546-fbf7a9a4af69 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.857111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:56.862602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2b5d4-3f3a-4afe-8546-fbf7a9a4af69 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.871308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40564b7b-00d2-415f-bd0e-1e06200e1674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.872393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40564b7b-00d2-415f-bd0e-1e06200e1674 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.872740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40564b7b-00d2-415f-bd0e-1e06200e1674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.873519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40564b7b-00d2-415f-bd0e-1e06200e1674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.874870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40564b7b-00d2-415f-bd0e-1e06200e1674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.877993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40564b7b-00d2-415f-bd0e-1e06200e1674 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.898914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 978/1950] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.903659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f928b-985c-4c1c-beb0-753de491e425 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.915844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f928b-985c-4c1c-beb0-753de491e425 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.925090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cd0b3-8bf3-4d25-ab09-b8664935b211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.925874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cd0b3-8bf3-4d25-ab09-b8664935b211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.926266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cd0b3-8bf3-4d25-ab09-b8664935b211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.926670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cd0b3-8bf3-4d25-ab09-b8664935b211 admin admin] PATH_INFO: `/v3/projects/3e290a0dc6a24f13a8d155abcd086b1a/users/7d33748ccfe5447b8c05481ae2c067dc/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.947469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cd0b3-8bf3-4d25-ab09-b8664935b211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e290a0dc6a24f13a8d155abcd086b1a, user_id=7d33748ccfe5447b8c05481ae2c067dc, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.950844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cd0b3-8bf3-4d25-ab09-b8664935b211 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.967374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 973/1951] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:56 2022] PUT /identity/v3/projects/3e290a0dc6a24f13a8d155abcd086b1a/users/7d33748ccfe5447b8c05481ae2c067dc/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:56.971260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40564b7b-00d2-415f-bd0e-1e06200e1674 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.982881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40564b7b-00d2-415f-bd0e-1e06200e1674 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.067588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d81ebc-57c3-4cb3-a2d7-7d23bce09587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.068535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d81ebc-57c3-4cb3-a2d7-7d23bce09587 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.068825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d81ebc-57c3-4cb3-a2d7-7d23bce09587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.069103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d81ebc-57c3-4cb3-a2d7-7d23bce09587 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.070254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d81ebc-57c3-4cb3-a2d7-7d23bce09587 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.072303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d81ebc-57c3-4cb3-a2d7-7d23bce09587 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.085807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 979/1952] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:57.087041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cd0b3-8bf3-4d25-ab09-b8664935b211 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.098195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cd0b3-8bf3-4d25-ab09-b8664935b211 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.103893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31471ed0-0da3-4c0d-b91c-0975ba3229d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.104734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31471ed0-0da3-4c0d-b91c-0975ba3229d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.105010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31471ed0-0da3-4c0d-b91c-0975ba3229d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.105423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31471ed0-0da3-4c0d-b91c-0975ba3229d8 admin admin] PATH_INFO: `/v3/projects/3e290a0dc6a24f13a8d155abcd086b1a/users/7d33748ccfe5447b8c05481ae2c067dc/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.108261 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31471ed0-0da3-4c0d-b91c-0975ba3229d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e290a0dc6a24f13a8d155abcd086b1a, user_id=7d33748ccfe5447b8c05481ae2c067dc, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.111847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31471ed0-0da3-4c0d-b91c-0975ba3229d8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.119430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d81ebc-57c3-4cb3-a2d7-7d23bce09587 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.121590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a7d81ebc-57c3-4cb3-a2d7-7d23bce09587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.124714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 974/1953] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:57 2022] PUT /identity/v3/projects/3e290a0dc6a24f13a8d155abcd086b1a/users/7d33748ccfe5447b8c05481ae2c067dc/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:57.135402 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d81ebc-57c3-4cb3-a2d7-7d23bce09587 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.135514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0654-959b-4f62-b2fd-7c24ede22ca4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.135783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0654-959b-4f62-b2fd-7c24ede22ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.136126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0654-959b-4f62-b2fd-7c24ede22ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.169991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-85ed0654-959b-4f62-b2fd-7c24ede22ca4 None None] MFA Rules not processed for user `7d33748ccfe5447b8c05481ae2c067dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:57.171860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-85ed0654-959b-4f62-b2fd-7c24ede22ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.211631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.212351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.212811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.213096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] PATH_INFO: `/v3/projects/3c250ef732744ffebbe4e136eaa4f488` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.219373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c250ef732744ffebbe4e136eaa4f488)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.221406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.263554 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 975/1954] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:57.274723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0654-959b-4f62-b2fd-7c24ede22ca4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.276032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c250ef732744ffebbe4e136eaa4f488', 'request_id': 'req-00c93b54-90a9-4619-a676-4655927c4a7e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.276182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-85ed0654-959b-4f62-b2fd-7c24ede22ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.283005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c250ef732744ffebbe4e136eaa4f488', 'request_id': 'req-00c93b54-90a9-4619-a676-4655927c4a7e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.292606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c250ef732744ffebbe4e136eaa4f488', 'request_id': 'req-00c93b54-90a9-4619-a676-4655927c4a7e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.309808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] The token cache is being invalidate because project 3c250ef732744ffebbe4e136eaa4f488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:57.310101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.310763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.312594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 980/1955] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:57 2022] DELETE /identity/v3/projects/3c250ef732744ffebbe4e136eaa4f488 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:57.316523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.318882 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.346430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.351334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0654-959b-4f62-b2fd-7c24ede22ca4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.380272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.396877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c93b54-90a9-4619-a676-4655927c4a7e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.402772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.403515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.403798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.404070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] PATH_INFO: `/v3/users/02f3816c2e3c46809112bb7a65db1baa` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.405279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f3816c2e3c46809112bb7a65db1baa)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.407212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.416292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cd051-fc87-4722-bc49-df2451c68e59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.419788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cd051-fc87-4722-bc49-df2451c68e59 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.420262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cd051-fc87-4722-bc49-df2451c68e59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.420544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cd051-fc87-4722-bc49-df2451c68e59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.422755 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-829cd051-fc87-4722-bc49-df2451c68e59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.465129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f3816c2e3c46809112bb7a65db1baa'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.482716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f3816c2e3c46809112bb7a65db1baa'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.494706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f3816c2e3c46809112bb7a65db1baa'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.495918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f3816c2e3c46809112bb7a65db1baa'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.499525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f3816c2e3c46809112bb7a65db1baa'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.511046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cd051-fc87-4722-bc49-df2451c68e59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.512787 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cd051-fc87-4722-bc49-df2451c68e59 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.514615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 981/1956] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:40:57 2022] DELETE /identity/v3/users/02f3816c2e3c46809112bb7a65db1baa => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:57.523282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 976/1957] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:57.608665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.610072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.670563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ca470-850c-4f0c-a1e5-5112525e0c82 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.674392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ddea73-0bb1-4215-8207-b7020bf608df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.675071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddea73-0bb1-4215-8207-b7020bf608df service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.675278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddea73-0bb1-4215-8207-b7020bf608df service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.675556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ddea73-0bb1-4215-8207-b7020bf608df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.677941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-11ddea73-0bb1-4215-8207-b7020bf608df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.753504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.758683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddea73-0bb1-4215-8207-b7020bf608df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.760167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ddea73-0bb1-4215-8207-b7020bf608df service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.771864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 982/1958] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:57.817415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cd051-fc87-4722-bc49-df2451c68e59 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.834698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cd051-fc87-4722-bc49-df2451c68e59 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.931513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.932680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.932680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.932896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] PATH_INFO: `/v3/projects/8547d6d1fcbc4c989d37d8be7f92bf46` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.933898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8547d6d1fcbc4c989d37d8be7f92bf46)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.935912 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.990939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8547d6d1fcbc4c989d37d8be7f92bf46', 'request_id': 'req-2a681054-7f0d-4a7d-a232-16c3be458fd1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:57.999677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8547d6d1fcbc4c989d37d8be7f92bf46', 'request_id': 'req-2a681054-7f0d-4a7d-a232-16c3be458fd1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:58.009049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8547d6d1fcbc4c989d37d8be7f92bf46', 'request_id': 'req-2a681054-7f0d-4a7d-a232-16c3be458fd1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:58.022716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] The token cache is being invalidate because project 8547d6d1fcbc4c989d37d8be7f92bf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:40:58.022716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:58.023310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2a681054-7f0d-4a7d-a232-16c3be458fd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:40:58.025682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 977/1959] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:40:57 2022] DELETE /identity/v3/projects/8547d6d1fcbc4c989d37d8be7f92bf46 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:58.030729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b7a12-ad08-4fe8-a09c-7600d1eb44c3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.031235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b7a12-ad08-4fe8-a09c-7600d1eb44c3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.031313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b7a12-ad08-4fe8-a09c-7600d1eb44c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.052926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f09b7a12-ad08-4fe8-a09c-7600d1eb44c3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:58.054537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f09b7a12-ad08-4fe8-a09c-7600d1eb44c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:58.137089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 983/1960] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:58.145209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff2ee-ef86-429f-875b-3fa6f5577af8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.145828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff2ee-ef86-429f-875b-3fa6f5577af8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.145828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cff2ee-ef86-429f-875b-3fa6f5577af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.172188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:58.182065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c3cff2ee-ef86-429f-875b-3fa6f5577af8 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:58.183502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c3cff2ee-ef86-429f-875b-3fa6f5577af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:58.196781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 978/1961] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:58.199708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b7a12-ad08-4fe8-a09c-7600d1eb44c3 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.213006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b7a12-ad08-4fe8-a09c-7600d1eb44c3 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.219553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847ce8-05ad-43c3-b6fb-66cb7b22a29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.220215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847ce8-05ad-43c3-b6fb-66cb7b22a29f admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.220498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847ce8-05ad-43c3-b6fb-66cb7b22a29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.220773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef847ce8-05ad-43c3-b6fb-66cb7b22a29f admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.221479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef847ce8-05ad-43c3-b6fb-66cb7b22a29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:58.221785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef847ce8-05ad-43c3-b6fb-66cb7b22a29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.223382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef847ce8-05ad-43c3-b6fb-66cb7b22a29f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.238565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 984/1962] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:58.244495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff2ee-ef86-429f-875b-3fa6f5577af8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.254275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cff2ee-ef86-429f-875b-3fa6f5577af8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.259036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249fd47-9956-4954-bbaf-2978db87941b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.259650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249fd47-9956-4954-bbaf-2978db87941b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.259930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249fd47-9956-4954-bbaf-2978db87941b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.260234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249fd47-9956-4954-bbaf-2978db87941b admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.260906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249fd47-9956-4954-bbaf-2978db87941b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.262787 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249fd47-9956-4954-bbaf-2978db87941b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.291369 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 979/1963] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:58.295375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847ce8-05ad-43c3-b6fb-66cb7b22a29f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.305184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef847ce8-05ad-43c3-b6fb-66cb7b22a29f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.359825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410080e1-b353-4ebe-9d33-c145407b1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.360487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410080e1-b353-4ebe-9d33-c145407b1d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.360769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410080e1-b353-4ebe-9d33-c145407b1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.361041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410080e1-b353-4ebe-9d33-c145407b1d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.361701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410080e1-b353-4ebe-9d33-c145407b1d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.363608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410080e1-b353-4ebe-9d33-c145407b1d52 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.383847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 985/1964] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:58.387969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249fd47-9956-4954-bbaf-2978db87941b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.398546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249fd47-9956-4954-bbaf-2978db87941b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.403370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf6992-79ee-4471-8561-0116a66386f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.403974 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf6992-79ee-4471-8561-0116a66386f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.404295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf6992-79ee-4471-8561-0116a66386f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.404574 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf6992-79ee-4471-8561-0116a66386f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.405268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf6992-79ee-4471-8561-0116a66386f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.406845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf6992-79ee-4471-8561-0116a66386f9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.417270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 980/1965] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:58.421075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410080e1-b353-4ebe-9d33-c145407b1d52 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.430823 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410080e1-b353-4ebe-9d33-c145407b1d52 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.435392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63075c8-e786-47b2-8b50-4ee63fccfa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.435992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63075c8-e786-47b2-8b50-4ee63fccfa00 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.436307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63075c8-e786-47b2-8b50-4ee63fccfa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.436582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63075c8-e786-47b2-8b50-4ee63fccfa00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.437266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63075c8-e786-47b2-8b50-4ee63fccfa00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.438906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63075c8-e786-47b2-8b50-4ee63fccfa00 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.449043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 986/1966] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:58.453145 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf6992-79ee-4471-8561-0116a66386f9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.463416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf6992-79ee-4471-8561-0116a66386f9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.467973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef45b9-1c99-4f2d-a8a0-8b9710dd5d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.468659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef45b9-1c99-4f2d-a8a0-8b9710dd5d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.468945 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef45b9-1c99-4f2d-a8a0-8b9710dd5d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.469223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef45b9-1c99-4f2d-a8a0-8b9710dd5d25 admin admin] PATH_INFO: `/v3/projects/3f099a5bda3e4cad9adaeaaa299690d2/users/636ac3e116734084a2304b48cbb23bf0/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.483977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef45b9-1c99-4f2d-a8a0-8b9710dd5d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f099a5bda3e4cad9adaeaaa299690d2, user_id=636ac3e116734084a2304b48cbb23bf0, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.486629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef45b9-1c99-4f2d-a8a0-8b9710dd5d25 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.499171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 981/1967] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:58 2022] PUT /identity/v3/projects/3f099a5bda3e4cad9adaeaaa299690d2/users/636ac3e116734084a2304b48cbb23bf0/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:58.516511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec21e2-8ac1-4972-a13b-34ef91a56496 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.516803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec21e2-8ac1-4972-a13b-34ef91a56496 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.517085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec21e2-8ac1-4972-a13b-34ef91a56496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.545448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e8ec21e2-8ac1-4972-a13b-34ef91a56496 None None] MFA Rules not processed for user `636ac3e116734084a2304b48cbb23bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:58.546639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e8ec21e2-8ac1-4972-a13b-34ef91a56496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:58.595232 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:58.613603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 987/1968] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:58.618025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef45b9-1c99-4f2d-a8a0-8b9710dd5d25 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.681055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef45b9-1c99-4f2d-a8a0-8b9710dd5d25 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.685931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabe501-70fd-49d2-8b90-1baf3365a5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.686540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe501-70fd-49d2-8b90-1baf3365a5f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.686820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe501-70fd-49d2-8b90-1baf3365a5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.687093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabe501-70fd-49d2-8b90-1baf3365a5f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.687748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabe501-70fd-49d2-8b90-1baf3365a5f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.689713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabe501-70fd-49d2-8b90-1baf3365a5f5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.716378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 982/1969] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:58.720683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec21e2-8ac1-4972-a13b-34ef91a56496 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.731229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec21e2-8ac1-4972-a13b-34ef91a56496 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.786114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93bf7a-0b2a-4fe1-8550-6ef1d64fa495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.786748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bf7a-0b2a-4fe1-8550-6ef1d64fa495 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.787026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bf7a-0b2a-4fe1-8550-6ef1d64fa495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.787298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93bf7a-0b2a-4fe1-8550-6ef1d64fa495 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.787947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93bf7a-0b2a-4fe1-8550-6ef1d64fa495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.789897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93bf7a-0b2a-4fe1-8550-6ef1d64fa495 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.810973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 988/1970] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:58.815133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabe501-70fd-49d2-8b90-1baf3365a5f5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.825789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabe501-70fd-49d2-8b90-1baf3365a5f5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.830413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3ce98-50f4-4a34-9ab8-da5078c7586c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.831015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ce98-50f4-4a34-9ab8-da5078c7586c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.831300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ce98-50f4-4a34-9ab8-da5078c7586c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.831577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3ce98-50f4-4a34-9ab8-da5078c7586c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.832308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3ce98-50f4-4a34-9ab8-da5078c7586c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.834579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3ce98-50f4-4a34-9ab8-da5078c7586c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.845320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 983/1971] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:58.849305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93bf7a-0b2a-4fe1-8550-6ef1d64fa495 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.859400 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93bf7a-0b2a-4fe1-8550-6ef1d64fa495 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.864154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac97d7-984f-4230-9942-516ff1f0b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.865337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac97d7-984f-4230-9942-516ff1f0b992 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.865617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac97d7-984f-4230-9942-516ff1f0b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.865890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac97d7-984f-4230-9942-516ff1f0b992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.866586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac97d7-984f-4230-9942-516ff1f0b992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.868228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac97d7-984f-4230-9942-516ff1f0b992 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.877918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 989/1972] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:58.882419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3ce98-50f4-4a34-9ab8-da5078c7586c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.892230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3ce98-50f4-4a34-9ab8-da5078c7586c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.897131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0f267-72a2-4d3b-ae87-b34cc54576bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.897784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0f267-72a2-4d3b-ae87-b34cc54576bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.898061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0f267-72a2-4d3b-ae87-b34cc54576bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.898332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0f267-72a2-4d3b-ae87-b34cc54576bd admin admin] PATH_INFO: `/v3/projects/3c7693bc176d4371b8c2fb45dee7ae04/users/3a26eb5e665944ae87b70abc3239e140/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.919386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0f267-72a2-4d3b-ae87-b34cc54576bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7693bc176d4371b8c2fb45dee7ae04, user_id=3a26eb5e665944ae87b70abc3239e140, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.919386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0f267-72a2-4d3b-ae87-b34cc54576bd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.932577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 984/1973] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:58 2022] PUT /identity/v3/projects/3c7693bc176d4371b8c2fb45dee7ae04/users/3a26eb5e665944ae87b70abc3239e140/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:59.000237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434d0f4-f348-4122-95e0-c51cff4ef270 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.000529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434d0f4-f348-4122-95e0-c51cff4ef270 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.000814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434d0f4-f348-4122-95e0-c51cff4ef270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.028968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a434d0f4-f348-4122-95e0-c51cff4ef270 None None] MFA Rules not processed for user `3a26eb5e665944ae87b70abc3239e140`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:59.030192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a434d0f4-f348-4122-95e0-c51cff4ef270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:59.096023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 990/1974] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:59.100412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0f267-72a2-4d3b-ae87-b34cc54576bd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.155267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:59.166730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0f267-72a2-4d3b-ae87-b34cc54576bd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.171675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b820a4d-688c-4de4-82b6-5bab749a8484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.172330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b820a4d-688c-4de4-82b6-5bab749a8484 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.172613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b820a4d-688c-4de4-82b6-5bab749a8484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.173023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b820a4d-688c-4de4-82b6-5bab749a8484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.173703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b820a4d-688c-4de4-82b6-5bab749a8484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.175618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b820a4d-688c-4de4-82b6-5bab749a8484 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.207270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 985/1975] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:59 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:59.211361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434d0f4-f348-4122-95e0-c51cff4ef270 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.223636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434d0f4-f348-4122-95e0-c51cff4ef270 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.288372 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:59.296047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6537-3d54-49fc-8e52-cf3a2a86a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.297264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6537-3d54-49fc-8e52-cf3a2a86a328 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.297795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6537-3d54-49fc-8e52-cf3a2a86a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.298157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e6537-3d54-49fc-8e52-cf3a2a86a328 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.300238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e6537-3d54-49fc-8e52-cf3a2a86a328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.301713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e6537-3d54-49fc-8e52-cf3a2a86a328 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.325202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 991/1976] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:59 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:40:59.329045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b820a4d-688c-4de4-82b6-5bab749a8484 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.341216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b820a4d-688c-4de4-82b6-5bab749a8484 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.345596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19084168-ba7a-4903-b25d-86580f6dc798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.346451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19084168-ba7a-4903-b25d-86580f6dc798 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.346832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19084168-ba7a-4903-b25d-86580f6dc798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.347132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19084168-ba7a-4903-b25d-86580f6dc798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.347834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19084168-ba7a-4903-b25d-86580f6dc798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.350048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19084168-ba7a-4903-b25d-86580f6dc798 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.362234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 986/1977] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:40:59.368021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6537-3d54-49fc-8e52-cf3a2a86a328 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.380039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e6537-3d54-49fc-8e52-cf3a2a86a328 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.385109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91886cec-e0eb-483c-ad1a-21f491b595b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.385784 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91886cec-e0eb-483c-ad1a-21f491b595b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.386068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91886cec-e0eb-483c-ad1a-21f491b595b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.386361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91886cec-e0eb-483c-ad1a-21f491b595b9 admin admin] PATH_INFO: `/v3/projects/bf9e66e3f6f44b759349fc287294acb1/users/67beaf0b2abb4850ad84ae20d7faa937/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.401479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91886cec-e0eb-483c-ad1a-21f491b595b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9e66e3f6f44b759349fc287294acb1, user_id=67beaf0b2abb4850ad84ae20d7faa937, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.404469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91886cec-e0eb-483c-ad1a-21f491b595b9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.426543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 992/1978] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:59 2022] PUT /identity/v3/projects/bf9e66e3f6f44b759349fc287294acb1/users/67beaf0b2abb4850ad84ae20d7faa937/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:59.426696 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19084168-ba7a-4903-b25d-86580f6dc798 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.433714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19084168-ba7a-4903-b25d-86580f6dc798 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.488320 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fbd7d-0c76-42a3-903c-d4a666cf5870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.488936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fbd7d-0c76-42a3-903c-d4a666cf5870 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.489224 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fbd7d-0c76-42a3-903c-d4a666cf5870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.489496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fbd7d-0c76-42a3-903c-d4a666cf5870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.490839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fbd7d-0c76-42a3-903c-d4a666cf5870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.492455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fbd7d-0c76-42a3-903c-d4a666cf5870 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.502035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 987/1979] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:59 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:59.506789 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91886cec-e0eb-483c-ad1a-21f491b595b9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.516915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91886cec-e0eb-483c-ad1a-21f491b595b9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.522117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195be2d-ab1b-457d-9535-011c6362b66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.522779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195be2d-ab1b-457d-9535-011c6362b66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.523061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195be2d-ab1b-457d-9535-011c6362b66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.523335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3195be2d-ab1b-457d-9535-011c6362b66e admin admin] PATH_INFO: `/v3/projects/bf9e66e3f6f44b759349fc287294acb1/users/67beaf0b2abb4850ad84ae20d7faa937/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.525294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195be2d-ab1b-457d-9535-011c6362b66e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf9e66e3f6f44b759349fc287294acb1, user_id=67beaf0b2abb4850ad84ae20d7faa937, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.528261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3195be2d-ab1b-457d-9535-011c6362b66e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.538190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 993/1980] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:59 2022] PUT /identity/v3/projects/bf9e66e3f6f44b759349fc287294acb1/users/67beaf0b2abb4850ad84ae20d7faa937/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:59.548159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e3c3-a445-4965-9baf-44504efa1499 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.548450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e3c3-a445-4965-9baf-44504efa1499 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.548723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152e3c3-a445-4965-9baf-44504efa1499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.577074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8152e3c3-a445-4965-9baf-44504efa1499 None None] MFA Rules not processed for user `67beaf0b2abb4850ad84ae20d7faa937`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:59.578442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8152e3c3-a445-4965-9baf-44504efa1499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:59.647922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 988/1981] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:59.659469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195be2d-ab1b-457d-9535-011c6362b66e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.661136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3195be2d-ab1b-457d-9535-011c6362b66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:59.717293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3195be2d-ab1b-457d-9535-011c6362b66e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.720995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c0a28-6271-4fde-871d-864d8a1734e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.721616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c0a28-6271-4fde-871d-864d8a1734e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.721897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c0a28-6271-4fde-871d-864d8a1734e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.722171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c0a28-6271-4fde-871d-864d8a1734e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.777985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c0a28-6271-4fde-871d-864d8a1734e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.779426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776c0a28-6271-4fde-871d-864d8a1734e0 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.788368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 994/1982] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:03.659856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152e3c3-a445-4965-9baf-44504efa1499 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:03.661899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8152e3c3-a445-4965-9baf-44504efa1499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:03.674594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152e3c3-a445-4965-9baf-44504efa1499 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:03.678395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ff9db-f05f-46c7-83f7-d58655b783a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:03.679016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ff9db-f05f-46c7-83f7-d58655b783a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:03.679295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ff9db-f05f-46c7-83f7-d58655b783a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:03.679567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ff9db-f05f-46c7-83f7-d58655b783a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:03.736986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:03.752517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ff9db-f05f-46c7-83f7-d58655b783a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:03.754534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ff9db-f05f-46c7-83f7-d58655b783a2 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:03.767573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 989/1983] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:04.568986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c0a28-6271-4fde-871d-864d8a1734e0 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:04.579289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776c0a28-6271-4fde-871d-864d8a1734e0 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:04.585401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443f228-411a-4c29-adaf-5011fd3d13f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:04.585742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f228-411a-4c29-adaf-5011fd3d13f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:04.586105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f228-411a-4c29-adaf-5011fd3d13f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:04.586624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443f228-411a-4c29-adaf-5011fd3d13f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:04.597312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443f228-411a-4c29-adaf-5011fd3d13f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:04.599825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443f228-411a-4c29-adaf-5011fd3d13f6 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:04.611201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 995/1984] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:05.383159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ff9db-f05f-46c7-83f7-d58655b783a2 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:05.384630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f66ff9db-f05f-46c7-83f7-d58655b783a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:05.461388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ff9db-f05f-46c7-83f7-d58655b783a2 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:05.466086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:05.466735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:05.467047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:05.467322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] PATH_INFO: `/v3/users/9ef38c123f504bcf9150a1b3f44cb5e6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:05.468527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ef38c123f504bcf9150a1b3f44cb5e6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:05.470471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:05.517623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ef38c123f504bcf9150a1b3f44cb5e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.525195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ef38c123f504bcf9150a1b3f44cb5e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.532452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ef38c123f504bcf9150a1b3f44cb5e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.533085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ef38c123f504bcf9150a1b3f44cb5e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.533705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ef38c123f504bcf9150a1b3f44cb5e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.551043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 990/1985] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:05 2022] DELETE /identity/v3/users/9ef38c123f504bcf9150a1b3f44cb5e6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:05.555541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1a01d-f236-4b77-9a9c-e2087217ad45 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:05.555829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1a01d-f236-4b77-9a9c-e2087217ad45 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:05.556112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1a01d-f236-4b77-9a9c-e2087217ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:05.576085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-33a1a01d-f236-4b77-9a9c-e2087217ad45 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:05.577308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-33a1a01d-f236-4b77-9a9c-e2087217ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:05.624773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:05.640531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 996/1986] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:05.650066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:05.651506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:05.712355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3f8e5-195d-4d3b-8bc0-26a40ee239e2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:05.715839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea219-e9ca-4e63-ab9c-6b04018ff53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:05.716492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea219-e9ca-4e63-ab9c-6b04018ff53f service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:05.716774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea219-e9ca-4e63-ab9c-6b04018ff53f service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:05.717046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eea219-e9ca-4e63-ab9c-6b04018ff53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:05.726120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eea219-e9ca-4e63-ab9c-6b04018ff53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:05.727582 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eea219-e9ca-4e63-ab9c-6b04018ff53f service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:05.737072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 991/1987] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:06.037522 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1a01d-f236-4b77-9a9c-e2087217ad45 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:06.039691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-33a1a01d-f236-4b77-9a9c-e2087217ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:06.060513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1a01d-f236-4b77-9a9c-e2087217ad45 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:06.073142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:06.073885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:06.074962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:06.075294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] PATH_INFO: `/v3/projects/db10ea2b998a41a7bdab830a2d221f4e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:06.076843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db10ea2b998a41a7bdab830a2d221f4e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:06.091767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:06.162782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db10ea2b998a41a7bdab830a2d221f4e', 'request_id': 'req-db6e580a-24cf-4345-bc95-b9ea26d57889'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.169179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db10ea2b998a41a7bdab830a2d221f4e', 'request_id': 'req-db6e580a-24cf-4345-bc95-b9ea26d57889'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.177078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db10ea2b998a41a7bdab830a2d221f4e', 'request_id': 'req-db6e580a-24cf-4345-bc95-b9ea26d57889'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.187181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] The token cache is being invalidate because project db10ea2b998a41a7bdab830a2d221f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:06.187464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.188079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.189624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 997/1988] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:06 2022] DELETE /identity/v3/projects/db10ea2b998a41a7bdab830a2d221f4e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:06.194127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea219-e9ca-4e63-ab9c-6b04018ff53f service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:06.203585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eea219-e9ca-4e63-ab9c-6b04018ff53f service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:06.208040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:06.269449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:06.270020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:06.270343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:06.271392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] PATH_INFO: `/v3/users/9d255cc303504d53a6df4eecd45014a7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:06.273404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d255cc303504d53a6df4eecd45014a7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:06.275513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:06.338046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d255cc303504d53a6df4eecd45014a7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.346447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d255cc303504d53a6df4eecd45014a7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.360439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d255cc303504d53a6df4eecd45014a7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.362166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d255cc303504d53a6df4eecd45014a7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.362916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-66c0ce4e-1908-435a-9cb1-b7c6dfdfa923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d255cc303504d53a6df4eecd45014a7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.398358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 992/1989] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:06 2022] DELETE /identity/v3/users/9d255cc303504d53a6df4eecd45014a7 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:06.561850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:06.563327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:06.590801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e580a-24cf-4345-bc95-b9ea26d57889 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:06.702818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:06.703892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:06.703892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:06.704351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] PATH_INFO: `/v3/users/544c64f22f8140cf8b92207e7eb41d9a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:06.705661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544c64f22f8140cf8b92207e7eb41d9a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:06.708530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:06.772031 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544c64f22f8140cf8b92207e7eb41d9a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.785089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544c64f22f8140cf8b92207e7eb41d9a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.793830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544c64f22f8140cf8b92207e7eb41d9a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.794712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544c64f22f8140cf8b92207e7eb41d9a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.800230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544c64f22f8140cf8b92207e7eb41d9a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.806725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:06.832645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 998/1990] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:06 2022] DELETE /identity/v3/users/544c64f22f8140cf8b92207e7eb41d9a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:06.835220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901c81-6356-4f36-8c91-3a3f99319310 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:06.835513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901c81-6356-4f36-8c91-3a3f99319310 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:06.835796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901c81-6356-4f36-8c91-3a3f99319310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:06.870430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7b901c81-6356-4f36-8c91-3a3f99319310 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:06.871502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:06.871697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b901c81-6356-4f36-8c91-3a3f99319310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:06.873671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:06.960267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaab38c-b81f-498d-97f7-0f2c19c4b009 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:06.960955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 993/1991] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:06.962770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:06.963630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:06.963921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:06.964229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] PATH_INFO: `/v3/projects/1b9831a2f2f9417e84d90f9104a0b771` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:06.965494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9831a2f2f9417e84d90f9104a0b771)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:06.967940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:06.968366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b901c81-6356-4f36-8c91-3a3f99319310 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:06.970457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b901c81-6356-4f36-8c91-3a3f99319310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.027595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:07.053001 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9831a2f2f9417e84d90f9104a0b771', 'request_id': 'req-86f50db6-0d10-4cb6-b01c-5264271c860a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.060980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9831a2f2f9417e84d90f9104a0b771', 'request_id': 'req-86f50db6-0d10-4cb6-b01c-5264271c860a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.069150 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b901c81-6356-4f36-8c91-3a3f99319310 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.071959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9831a2f2f9417e84d90f9104a0b771', 'request_id': 'req-86f50db6-0d10-4cb6-b01c-5264271c860a'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.084532 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] The token cache is being invalidate because project 1b9831a2f2f9417e84d90f9104a0b771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:07.084953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.085620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86f50db6-0d10-4cb6-b01c-5264271c860a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.087426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 999/1992] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:06 2022] DELETE /identity/v3/projects/1b9831a2f2f9417e84d90f9104a0b771 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:07.092992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f16be-6049-4eac-9262-57c76188dc0c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.093434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f16be-6049-4eac-9262-57c76188dc0c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.093776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f16be-6049-4eac-9262-57c76188dc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.118667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c47f16be-6049-4eac-9262-57c76188dc0c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:07.121565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c47f16be-6049-4eac-9262-57c76188dc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.148893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769538c2-fcc0-4fab-8304-8ee535e9b068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.149817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769538c2-fcc0-4fab-8304-8ee535e9b068 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.150250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769538c2-fcc0-4fab-8304-8ee535e9b068 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.151095 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769538c2-fcc0-4fab-8304-8ee535e9b068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.153651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-769538c2-fcc0-4fab-8304-8ee535e9b068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.217161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1000/1993] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:07.230974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f1b5-96bd-4ce3-9df6-5d6da6fc30dd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.232280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f1b5-96bd-4ce3-9df6-5d6da6fc30dd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.234377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400f1b5-96bd-4ce3-9df6-5d6da6fc30dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.253532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769538c2-fcc0-4fab-8304-8ee535e9b068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.255966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769538c2-fcc0-4fab-8304-8ee535e9b068 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.273911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 994/1994] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:07.281959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3400f1b5-96bd-4ce3-9df6-5d6da6fc30dd None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:07.283448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3400f1b5-96bd-4ce3-9df6-5d6da6fc30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.296965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1001/1995] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:07.298647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769538c2-fcc0-4fab-8304-8ee535e9b068 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.327907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769538c2-fcc0-4fab-8304-8ee535e9b068 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.345806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a713bf-dc27-499b-8908-94d01334c1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.346649 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a713bf-dc27-499b-8908-94d01334c1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.347886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a713bf-dc27-499b-8908-94d01334c1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.348028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a713bf-dc27-499b-8908-94d01334c1ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.349170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a713bf-dc27-499b-8908-94d01334c1ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:07.349611 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a713bf-dc27-499b-8908-94d01334c1ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.351521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a713bf-dc27-499b-8908-94d01334c1ab admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.366970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 995/1996] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:07.371481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400f1b5-96bd-4ce3-9df6-5d6da6fc30dd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.384227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400f1b5-96bd-4ce3-9df6-5d6da6fc30dd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.389601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eabf1-9b6e-49cf-bd86-df5652d5df85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.390370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eabf1-9b6e-49cf-bd86-df5652d5df85 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.390757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eabf1-9b6e-49cf-bd86-df5652d5df85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.391199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eabf1-9b6e-49cf-bd86-df5652d5df85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.391982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eabf1-9b6e-49cf-bd86-df5652d5df85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.394240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8eabf1-9b6e-49cf-bd86-df5652d5df85 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.412301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:07.428086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1002/1997] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:07 2022] POST /identity/v3/projects => generated 357 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:07.432567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a713bf-dc27-499b-8908-94d01334c1ab admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.449679 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a713bf-dc27-499b-8908-94d01334c1ab admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.531106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27764d-062b-4d4f-af97-0ef7a2d68b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.531727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27764d-062b-4d4f-af97-0ef7a2d68b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.532008 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27764d-062b-4d4f-af97-0ef7a2d68b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.532317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27764d-062b-4d4f-af97-0ef7a2d68b3b admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.533495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27764d-062b-4d4f-af97-0ef7a2d68b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.535457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e27764d-062b-4d4f-af97-0ef7a2d68b3b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.560031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 996/1998] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:07 2022] POST /identity/v3/users => generated 279 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:41:07.564509 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eabf1-9b6e-49cf-bd86-df5652d5df85 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.575725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eabf1-9b6e-49cf-bd86-df5652d5df85 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.581198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ef4c4-043a-4fd0-905c-e4683a6ee1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.581965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ef4c4-043a-4fd0-905c-e4683a6ee1dc admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.582296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ef4c4-043a-4fd0-905c-e4683a6ee1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.583401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ef4c4-043a-4fd0-905c-e4683a6ee1dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.584237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ef4c4-043a-4fd0-905c-e4683a6ee1dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.585876 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ef4c4-043a-4fd0-905c-e4683a6ee1dc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.596451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1003/1999] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:07.600929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27764d-062b-4d4f-af97-0ef7a2d68b3b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.611094 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e27764d-062b-4d4f-af97-0ef7a2d68b3b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.616442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a3c0-8aa5-451b-80b7-f6d99698e6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.617058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a3c0-8aa5-451b-80b7-f6d99698e6ed admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.617384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a3c0-8aa5-451b-80b7-f6d99698e6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.617657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295a3c0-8aa5-451b-80b7-f6d99698e6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.618358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a3c0-8aa5-451b-80b7-f6d99698e6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.619938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295a3c0-8aa5-451b-80b7-f6d99698e6ed admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.626061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:07.636247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 997/2000] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:07.636839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ef4c4-043a-4fd0-905c-e4683a6ee1dc admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.649095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ef4c4-043a-4fd0-905c-e4683a6ee1dc admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.656058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8525e0-df0c-4346-8ba3-b97c8ac8f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.656957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8525e0-df0c-4346-8ba3-b97c8ac8f339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.657307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8525e0-df0c-4346-8ba3-b97c8ac8f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.657648 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8525e0-df0c-4346-8ba3-b97c8ac8f339 admin admin] PATH_INFO: `/v3/projects/396083acfc9a4fadb9c8c5585b4bc553/users/f14b2953982f450f8e722f1f1cd72860/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.686688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8525e0-df0c-4346-8ba3-b97c8ac8f339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396083acfc9a4fadb9c8c5585b4bc553, user_id=f14b2953982f450f8e722f1f1cd72860, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.689282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a3c0-8aa5-451b-80b7-f6d99698e6ed admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.691035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2295a3c0-8aa5-451b-80b7-f6d99698e6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.698225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8525e0-df0c-4346-8ba3-b97c8ac8f339 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.707622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295a3c0-8aa5-451b-80b7-f6d99698e6ed admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.718739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1004/2001] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:07 2022] PUT /identity/v3/projects/396083acfc9a4fadb9c8c5585b4bc553/users/f14b2953982f450f8e722f1f1cd72860/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:07.728951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.729619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.729895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.730164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] PATH_INFO: `/v3/projects/3e7b96cacb1441b08f120b4ce0085c4e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.731356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e7b96cacb1441b08f120b4ce0085c4e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.733215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526478-56bf-4a81-aff6-2b3463c710d3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.733338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.733907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526478-56bf-4a81-aff6-2b3463c710d3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.734959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c526478-56bf-4a81-aff6-2b3463c710d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.787794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6c526478-56bf-4a81-aff6-2b3463c710d3 None None] MFA Rules not processed for user `f14b2953982f450f8e722f1f1cd72860`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:07.788815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6c526478-56bf-4a81-aff6-2b3463c710d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.824688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e7b96cacb1441b08f120b4ce0085c4e', 'request_id': 'req-318f09ae-5c10-404a-b0e3-667ce685a20a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.835944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e7b96cacb1441b08f120b4ce0085c4e', 'request_id': 'req-318f09ae-5c10-404a-b0e3-667ce685a20a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.846348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e7b96cacb1441b08f120b4ce0085c4e', 'request_id': 'req-318f09ae-5c10-404a-b0e3-667ce685a20a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.861908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] The token cache is being invalidate because project 3e7b96cacb1441b08f120b4ce0085c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:07.862427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.863712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:07.867114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 998/2002] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:07 2022] DELETE /identity/v3/projects/3e7b96cacb1441b08f120b4ce0085c4e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:07.871503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.874669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.887220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1005/2003] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:07.891877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c526478-56bf-4a81-aff6-2b3463c710d3 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.893473 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6c526478-56bf-4a81-aff6-2b3463c710d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.950302 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318f09ae-5c10-404a-b0e3-667ce685a20a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.955919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.956871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.957410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.957691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] PATH_INFO: `/v3/users/7d33748ccfe5447b8c05481ae2c067dc` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.959423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d33748ccfe5447b8c05481ae2c067dc)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.961871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.980177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c526478-56bf-4a81-aff6-2b3463c710d3 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.984585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc52a3-a516-4ca9-9b7f-cdaaa48b916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.985204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc52a3-a516-4ca9-9b7f-cdaaa48b916c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.985486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc52a3-a516-4ca9-9b7f-cdaaa48b916c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.985760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc52a3-a516-4ca9-9b7f-cdaaa48b916c admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.986426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc52a3-a516-4ca9-9b7f-cdaaa48b916c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.988370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc52a3-a516-4ca9-9b7f-cdaaa48b916c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.018608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1006/2004] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:07 2022] POST /identity/v3/projects => generated 357 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:41:08.021575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d33748ccfe5447b8c05481ae2c067dc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.023027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc52a3-a516-4ca9-9b7f-cdaaa48b916c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.029189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d33748ccfe5447b8c05481ae2c067dc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.037887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d33748ccfe5447b8c05481ae2c067dc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.038775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d33748ccfe5447b8c05481ae2c067dc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.039424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d33748ccfe5447b8c05481ae2c067dc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.059303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 999/2005] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:07 2022] DELETE /identity/v3/users/7d33748ccfe5447b8c05481ae2c067dc => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:08.070064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:08.100617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc52a3-a516-4ca9-9b7f-cdaaa48b916c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.174150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af77490-770a-4fa2-9724-2338cc3b3016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.175065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af77490-770a-4fa2-9724-2338cc3b3016 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.175065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af77490-770a-4fa2-9724-2338cc3b3016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.175426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af77490-770a-4fa2-9724-2338cc3b3016 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.176035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af77490-770a-4fa2-9724-2338cc3b3016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.178553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af77490-770a-4fa2-9724-2338cc3b3016 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.205328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1007/2006] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:08 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:41:08.210754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.212256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.223209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:08.231120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6e5ed-11ea-4399-adff-05918c63ff7c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.239720 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775d72e-6337-4166-920a-e8398876b872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.241941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775d72e-6337-4166-920a-e8398876b872 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.242334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775d72e-6337-4166-920a-e8398876b872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.242553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775d72e-6337-4166-920a-e8398876b872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.243430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775d72e-6337-4166-920a-e8398876b872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.245257 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7775d72e-6337-4166-920a-e8398876b872 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.276301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1000/2007] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:08.277752 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af77490-770a-4fa2-9724-2338cc3b3016 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.292446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af77490-770a-4fa2-9724-2338cc3b3016 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.308760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec19f-1db5-47af-847b-05a675ca529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.309544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec19f-1db5-47af-847b-05a675ca529e admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.309904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec19f-1db5-47af-847b-05a675ca529e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.310264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec19f-1db5-47af-847b-05a675ca529e admin admin] PATH_INFO: `/v3/projects/14868b2d5d46456ea34083deb7122eb3/users/2aacb512c67245beb29fdd69319af48c/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.359810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec19f-1db5-47af-847b-05a675ca529e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14868b2d5d46456ea34083deb7122eb3, user_id=2aacb512c67245beb29fdd69319af48c, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.372908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ec19f-1db5-47af-847b-05a675ca529e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.400272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775d72e-6337-4166-920a-e8398876b872 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.404381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7775d72e-6337-4166-920a-e8398876b872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.409906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1008/2008] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:08 2022] PUT /identity/v3/projects/14868b2d5d46456ea34083deb7122eb3/users/2aacb512c67245beb29fdd69319af48c/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:08.413768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec19f-1db5-47af-847b-05a675ca529e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.420615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775d72e-6337-4166-920a-e8398876b872 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.501541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ec19f-1db5-47af-847b-05a675ca529e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.508458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34a240-b7a9-4443-9a3e-3c1bfe8cbf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.509094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34a240-b7a9-4443-9a3e-3c1bfe8cbf92 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.509478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34a240-b7a9-4443-9a3e-3c1bfe8cbf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.509761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34a240-b7a9-4443-9a3e-3c1bfe8cbf92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.510620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34a240-b7a9-4443-9a3e-3c1bfe8cbf92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.512773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b34a240-b7a9-4443-9a3e-3c1bfe8cbf92 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.516826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.518046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.518545 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.519059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] PATH_INFO: `/v3/projects/3e290a0dc6a24f13a8d155abcd086b1a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.521943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e290a0dc6a24f13a8d155abcd086b1a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.524605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.530066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1009/2009] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:08.531599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34a240-b7a9-4443-9a3e-3c1bfe8cbf92 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.545533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b34a240-b7a9-4443-9a3e-3c1bfe8cbf92 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.551249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6d94a-71f6-4608-95ad-b202e9d62180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.552653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6d94a-71f6-4608-95ad-b202e9d62180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.553024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6d94a-71f6-4608-95ad-b202e9d62180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.553379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6d94a-71f6-4608-95ad-b202e9d62180 admin admin] PATH_INFO: `/v3/projects/14868b2d5d46456ea34083deb7122eb3/users/2aacb512c67245beb29fdd69319af48c/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.556033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6d94a-71f6-4608-95ad-b202e9d62180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14868b2d5d46456ea34083deb7122eb3, user_id=2aacb512c67245beb29fdd69319af48c, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.558859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6d94a-71f6-4608-95ad-b202e9d62180 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.571350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1010/2010] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:08 2022] PUT /identity/v3/projects/14868b2d5d46456ea34083deb7122eb3/users/2aacb512c67245beb29fdd69319af48c/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:08.587531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e290a0dc6a24f13a8d155abcd086b1a', 'request_id': 'req-0b572d9b-c36f-4b3c-a307-334b3b1dda33'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.588314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83064037-8e76-4cd1-8458-4bc1d53d87a8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.588611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83064037-8e76-4cd1-8458-4bc1d53d87a8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.588907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83064037-8e76-4cd1-8458-4bc1d53d87a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.597013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e290a0dc6a24f13a8d155abcd086b1a', 'request_id': 'req-0b572d9b-c36f-4b3c-a307-334b3b1dda33'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.612684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e290a0dc6a24f13a8d155abcd086b1a', 'request_id': 'req-0b572d9b-c36f-4b3c-a307-334b3b1dda33'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.626800 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] The token cache is being invalidate because project 3e290a0dc6a24f13a8d155abcd086b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:08.627086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.628426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0b572d9b-c36f-4b3c-a307-334b3b1dda33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.632723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-83064037-8e76-4cd1-8458-4bc1d53d87a8 None None] MFA Rules not processed for user `2aacb512c67245beb29fdd69319af48c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:08.634408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1001/2011] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:08 2022] DELETE /identity/v3/projects/3e290a0dc6a24f13a8d155abcd086b1a => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:08.637261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-83064037-8e76-4cd1-8458-4bc1d53d87a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.638015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6ce6-818a-4356-a0c9-51b6eff4eaf1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.638560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6ce6-818a-4356-a0c9-51b6eff4eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.639138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6ce6-818a-4356-a0c9-51b6eff4eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.661044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:08.661632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7bfd6ce6-818a-4356-a0c9-51b6eff4eaf1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:08.663232 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7bfd6ce6-818a-4356-a0c9-51b6eff4eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.758829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1011/2012] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:08.777380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83064037-8e76-4cd1-8458-4bc1d53d87a8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.779479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-83064037-8e76-4cd1-8458-4bc1d53d87a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.830003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1002/2013] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:08.837668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb98e-7a95-496d-be23-84fac5586b0f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.837969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb98e-7a95-496d-be23-84fac5586b0f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.838324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552fb98e-7a95-496d-be23-84fac5586b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.874640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-552fb98e-7a95-496d-be23-84fac5586b0f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:08.875852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-552fb98e-7a95-496d-be23-84fac5586b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.884942 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1003/2014] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:08.888849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb98e-7a95-496d-be23-84fac5586b0f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.899372 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83064037-8e76-4cd1-8458-4bc1d53d87a8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.904120 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e5182-fd49-4c55-9ff2-8e2d0ebb4371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.905026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e5182-fd49-4c55-9ff2-8e2d0ebb4371 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.905169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552fb98e-7a95-496d-be23-84fac5586b0f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.905633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e5182-fd49-4c55-9ff2-8e2d0ebb4371 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.906325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e5182-fd49-4c55-9ff2-8e2d0ebb4371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.910481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc7cf-8d9c-4e62-9b62-50054ac92e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.911213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc7cf-8d9c-4e62-9b62-50054ac92e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.911565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc7cf-8d9c-4e62-9b62-50054ac92e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.911834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cc7cf-8d9c-4e62-9b62-50054ac92e97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.912575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cc7cf-8d9c-4e62-9b62-50054ac92e97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:08.912877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cc7cf-8d9c-4e62-9b62-50054ac92e97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.914472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479cc7cf-8d9c-4e62-9b62-50054ac92e97 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.923586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e5182-fd49-4c55-9ff2-8e2d0ebb4371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.925436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e5182-fd49-4c55-9ff2-8e2d0ebb4371 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.942057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1012/2015] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:08 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:41:08.946736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1004/2016] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:41:08.957152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e5182-fd49-4c55-9ff2-8e2d0ebb4371 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.987587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e5182-fd49-4c55-9ff2-8e2d0ebb4371 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.006986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc9b0-3448-466f-866f-d6336a64b83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.007653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc9b0-3448-466f-866f-d6336a64b83a admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.007935 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc9b0-3448-466f-866f-d6336a64b83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.008239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecc9b0-3448-466f-866f-d6336a64b83a admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.008910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecc9b0-3448-466f-866f-d6336a64b83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.010830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecc9b0-3448-466f-866f-d6336a64b83a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.050033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1013/2017] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:08 2022] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:09.050169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc7cf-8d9c-4e62-9b62-50054ac92e97 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.051126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc9b0-3448-466f-866f-d6336a64b83a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.055938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:09.064866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479cc7cf-8d9c-4e62-9b62-50054ac92e97 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.122654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecc9b0-3448-466f-866f-d6336a64b83a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.123813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d304733-d863-495f-9177-b90773df381f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.125391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304733-d863-495f-9177-b90773df381f service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.125849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304733-d863-495f-9177-b90773df381f service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.126291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d304733-d863-495f-9177-b90773df381f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.128197 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7cc70-4c1e-42a0-a826-8104bfd91f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.128491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1d304733-d863-495f-9177-b90773df381f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:09.128825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7cc70-4c1e-42a0-a826-8104bfd91f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.129106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7cc70-4c1e-42a0-a826-8104bfd91f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.129409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c7cc70-4c1e-42a0-a826-8104bfd91f0d admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.130143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7cc70-4c1e-42a0-a826-8104bfd91f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.132071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c7cc70-4c1e-42a0-a826-8104bfd91f0d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.160024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1014/2018] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:09 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:09.165565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7cc70-4c1e-42a0-a826-8104bfd91f0d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.176557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c7cc70-4c1e-42a0-a826-8104bfd91f0d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.182431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9078-3347-488b-b4db-6c74204ffbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.183061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9078-3347-488b-b4db-6c74204ffbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.183339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9078-3347-488b-b4db-6c74204ffbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.183606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd9078-3347-488b-b4db-6c74204ffbd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.184347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd9078-3347-488b-b4db-6c74204ffbd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.186586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd9078-3347-488b-b4db-6c74204ffbd9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.198410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1015/2019] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:09.202110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9078-3347-488b-b4db-6c74204ffbd9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.209209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d304733-d863-495f-9177-b90773df381f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.210882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d304733-d863-495f-9177-b90773df381f service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.212865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd9078-3347-488b-b4db-6c74204ffbd9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.219307 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5754eb-0214-466d-904e-d0aa006386d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.219737 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5754eb-0214-466d-904e-d0aa006386d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.220015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5754eb-0214-466d-904e-d0aa006386d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.220318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5754eb-0214-466d-904e-d0aa006386d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.221696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5754eb-0214-466d-904e-d0aa006386d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.222831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5754eb-0214-466d-904e-d0aa006386d0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.224399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1005/2020] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:09.238087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1016/2021] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:09.239820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d304733-d863-495f-9177-b90773df381f service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.250936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d304733-d863-495f-9177-b90773df381f service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.256013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d03928-8538-46eb-a367-4e0c05188e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.256813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d03928-8538-46eb-a367-4e0c05188e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.257456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d03928-8538-46eb-a367-4e0c05188e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.257456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d03928-8538-46eb-a367-4e0c05188e58 admin admin] PATH_INFO: `/v3/projects/293a59b0807d497dbccd439a4ac0a3a0/users/8ff9746012514273ac5a33f7e91495ed/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.293073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d03928-8538-46eb-a367-4e0c05188e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293a59b0807d497dbccd439a4ac0a3a0, user_id=8ff9746012514273ac5a33f7e91495ed, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.296723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d03928-8538-46eb-a367-4e0c05188e58 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.322057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1006/2022] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:09 2022] PUT /identity/v3/projects/293a59b0807d497dbccd439a4ac0a3a0/users/8ff9746012514273ac5a33f7e91495ed/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:09.332534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef4165-996c-4dd7-b5d3-133852208879 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.332873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef4165-996c-4dd7-b5d3-133852208879 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.333409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef4165-996c-4dd7-b5d3-133852208879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.354583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:09.403767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-98ef4165-996c-4dd7-b5d3-133852208879 None None] MFA Rules not processed for user `8ff9746012514273ac5a33f7e91495ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:09.404596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-98ef4165-996c-4dd7-b5d3-133852208879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:09.544199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1017/2023] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:09.545744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d03928-8538-46eb-a367-4e0c05188e58 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.627907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d03928-8538-46eb-a367-4e0c05188e58 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.634038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cfe26-bddd-42fe-a52c-0541ce53f7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.634595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cfe26-bddd-42fe-a52c-0541ce53f7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.634877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cfe26-bddd-42fe-a52c-0541ce53f7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.635153 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cfe26-bddd-42fe-a52c-0541ce53f7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.635824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cfe26-bddd-42fe-a52c-0541ce53f7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.637802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cfe26-bddd-42fe-a52c-0541ce53f7b9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.669916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1007/2024] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:09 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:41:09.672941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef4165-996c-4dd7-b5d3-133852208879 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.683779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef4165-996c-4dd7-b5d3-133852208879 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.741022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4153e-1b33-48c6-b3b3-2db9696d6e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.741653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4153e-1b33-48c6-b3b3-2db9696d6e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.741948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4153e-1b33-48c6-b3b3-2db9696d6e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.742229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4153e-1b33-48c6-b3b3-2db9696d6e23 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.742894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4153e-1b33-48c6-b3b3-2db9696d6e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.744883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4153e-1b33-48c6-b3b3-2db9696d6e23 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.769902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1018/2025] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:09 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:09.772229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cfe26-bddd-42fe-a52c-0541ce53f7b9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.782897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cfe26-bddd-42fe-a52c-0541ce53f7b9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.787657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8a34e-7480-46a6-b7f6-cb55acd6549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.788385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8a34e-7480-46a6-b7f6-cb55acd6549a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.788738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8a34e-7480-46a6-b7f6-cb55acd6549a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.789081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8a34e-7480-46a6-b7f6-cb55acd6549a admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.789852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8a34e-7480-46a6-b7f6-cb55acd6549a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.791457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8a34e-7480-46a6-b7f6-cb55acd6549a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.807107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1008/2026] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:09.811591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4153e-1b33-48c6-b3b3-2db9696d6e23 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.822167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4153e-1b33-48c6-b3b3-2db9696d6e23 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.826941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc7b0a-e8f8-4f1b-a54e-77c30b67b115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.827619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc7b0a-e8f8-4f1b-a54e-77c30b67b115 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.827902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc7b0a-e8f8-4f1b-a54e-77c30b67b115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.828207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afc7b0a-e8f8-4f1b-a54e-77c30b67b115 admin admin] PATH_INFO: `/v3/projects/90498741c0884e529bdaf06183fc61de/users/188d03a6444c4b4598446b4c02157c24/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.846037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc7b0a-e8f8-4f1b-a54e-77c30b67b115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90498741c0884e529bdaf06183fc61de, user_id=188d03a6444c4b4598446b4c02157c24, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.848927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afc7b0a-e8f8-4f1b-a54e-77c30b67b115 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.861774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1019/2027] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:09 2022] PUT /identity/v3/projects/90498741c0884e529bdaf06183fc61de/users/188d03a6444c4b4598446b4c02157c24/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:09.865853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8a34e-7480-46a6-b7f6-cb55acd6549a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.875897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8a34e-7480-46a6-b7f6-cb55acd6549a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.879552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:09.959134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc7b0a-e8f8-4f1b-a54e-77c30b67b115 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.961907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3afc7b0a-e8f8-4f1b-a54e-77c30b67b115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:09.973110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f5250-f6cb-4eff-916a-d695c38acaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.973989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f5250-f6cb-4eff-916a-d695c38acaca admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.974283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f5250-f6cb-4eff-916a-d695c38acaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.974624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f5250-f6cb-4eff-916a-d695c38acaca admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.975276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f5250-f6cb-4eff-916a-d695c38acaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.978255 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f5250-f6cb-4eff-916a-d695c38acaca admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.008908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1009/2028] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:09 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:10.010494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f5250-f6cb-4eff-916a-d695c38acaca admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:10.022997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f5250-f6cb-4eff-916a-d695c38acaca admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.030384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b366392-7cb3-4527-ac77-05e1c8d6bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.031178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366392-7cb3-4527-ac77-05e1c8d6bacd admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.031465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366392-7cb3-4527-ac77-05e1c8d6bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.031740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366392-7cb3-4527-ac77-05e1c8d6bacd admin admin] PATH_INFO: `/v3/projects/90498741c0884e529bdaf06183fc61de/users/188d03a6444c4b4598446b4c02157c24/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.033875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b366392-7cb3-4527-ac77-05e1c8d6bacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=90498741c0884e529bdaf06183fc61de, user_id=188d03a6444c4b4598446b4c02157c24, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.036754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b366392-7cb3-4527-ac77-05e1c8d6bacd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.051107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1010/2029] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:10 2022] PUT /identity/v3/projects/90498741c0884e529bdaf06183fc61de/users/188d03a6444c4b4598446b4c02157c24/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:10.062277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f5af-231e-496f-ad28-dfc73ff6ae1f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.062589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f5af-231e-496f-ad28-dfc73ff6ae1f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.063510 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9f5af-231e-496f-ad28-dfc73ff6ae1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.068448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afc7b0a-e8f8-4f1b-a54e-77c30b67b115 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.074085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:10.100480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2fd9f5af-231e-496f-ad28-dfc73ff6ae1f None None] MFA Rules not processed for user `188d03a6444c4b4598446b4c02157c24`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:10.101774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2fd9f5af-231e-496f-ad28-dfc73ff6ae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:10.143293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.143865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.144172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.144457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] PATH_INFO: `/v3/users/636ac3e116734084a2304b48cbb23bf0` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.145705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=636ac3e116734084a2304b48cbb23bf0)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.148487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.187832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1011/2030] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:10.197712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f5af-231e-496f-ad28-dfc73ff6ae1f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:10.207316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636ac3e116734084a2304b48cbb23bf0'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:10.221262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636ac3e116734084a2304b48cbb23bf0'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:10.231957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636ac3e116734084a2304b48cbb23bf0'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:10.232834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636ac3e116734084a2304b48cbb23bf0'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:10.233530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-082a6326-1341-4e78-8f02-d3abf5d9d4cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636ac3e116734084a2304b48cbb23bf0'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:10.251396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1020/2031] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:09 2022] DELETE /identity/v3/users/636ac3e116734084a2304b48cbb23bf0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:10.256309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abcadf-95f0-4d4e-947a-7ca3b87aae92 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.256601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abcadf-95f0-4d4e-947a-7ca3b87aae92 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.256931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3abcadf-95f0-4d4e-947a-7ca3b87aae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.260746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9f5af-231e-496f-ad28-dfc73ff6ae1f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.277798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d3abcadf-95f0-4d4e-947a-7ca3b87aae92 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:10.279210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d3abcadf-95f0-4d4e-947a-7ca3b87aae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:10.294563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:10.323283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.323960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.324282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.324558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.326834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:10.344791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1021/2032] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:10.354556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abcadf-95f0-4d4e-947a-7ca3b87aae92 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:10.356529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d3abcadf-95f0-4d4e-947a-7ca3b87aae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:10.391199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:10.395509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.396960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.407206 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1012/2033] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:10.428517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3abcadf-95f0-4d4e-947a-7ca3b87aae92 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.433585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb34bb-8519-4f7b-9a52-a0f731f5c7f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.434202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb34bb-8519-4f7b-9a52-a0f731f5c7f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.435000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb34bb-8519-4f7b-9a52-a0f731f5c7f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.435358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb34bb-8519-4f7b-9a52-a0f731f5c7f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.447419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb34bb-8519-4f7b-9a52-a0f731f5c7f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.449057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb34bb-8519-4f7b-9a52-a0f731f5c7f8 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.460922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1022/2034] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:41:11.205735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.208214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:11.221483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4656ab3-0d0f-47b2-bdf9-0007672af88a service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:11.228546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:11.229195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:11.229541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:11.229830 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] PATH_INFO: `/v3/projects/3f099a5bda3e4cad9adaeaaa299690d2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:11.230997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f099a5bda3e4cad9adaeaaa299690d2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:11.232938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:11.291683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f099a5bda3e4cad9adaeaaa299690d2', 'request_id': 'req-9115a6c1-a703-438f-b95d-22ea6f5407c6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.302568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f099a5bda3e4cad9adaeaaa299690d2', 'request_id': 'req-9115a6c1-a703-438f-b95d-22ea6f5407c6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.311817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f099a5bda3e4cad9adaeaaa299690d2', 'request_id': 'req-9115a6c1-a703-438f-b95d-22ea6f5407c6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.324248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] The token cache is being invalidate because project 3f099a5bda3e4cad9adaeaaa299690d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:11.324759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.325547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.327442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1013/2035] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:11 2022] DELETE /identity/v3/projects/3f099a5bda3e4cad9adaeaaa299690d2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:11.331264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb34bb-8519-4f7b-9a52-a0f731f5c7f8 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.342740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb34bb-8519-4f7b-9a52-a0f731f5c7f8 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:11.409240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:11.410057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:11.410441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:11.410811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] PATH_INFO: `/v3/users/3a26eb5e665944ae87b70abc3239e140` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:11.412299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a26eb5e665944ae87b70abc3239e140)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:11.414450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:11.470987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a26eb5e665944ae87b70abc3239e140'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.485731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a26eb5e665944ae87b70abc3239e140'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.494531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a26eb5e665944ae87b70abc3239e140'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.496280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a26eb5e665944ae87b70abc3239e140'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.496280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a26eb5e665944ae87b70abc3239e140'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.513148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1023/2036] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:11 2022] DELETE /identity/v3/users/3a26eb5e665944ae87b70abc3239e140 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:12.731704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:12.733226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:12.747847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115a6c1-a703-438f-b95d-22ea6f5407c6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:12.845339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:12.846209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:12.846591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:12.847282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] PATH_INFO: `/v3/projects/3c7693bc176d4371b8c2fb45dee7ae04` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:12.848343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7693bc176d4371b8c2fb45dee7ae04)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:12.850779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:12.863631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:12.933020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7693bc176d4371b8c2fb45dee7ae04', 'request_id': 'req-e1807ad8-2735-4e96-b15b-aa6166d9d453'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.941398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7693bc176d4371b8c2fb45dee7ae04', 'request_id': 'req-e1807ad8-2735-4e96-b15b-aa6166d9d453'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.948637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7693bc176d4371b8c2fb45dee7ae04', 'request_id': 'req-e1807ad8-2735-4e96-b15b-aa6166d9d453'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.959723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] The token cache is being invalidate because project 3c7693bc176d4371b8c2fb45dee7ae04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:12.959989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.960675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.962506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1014/2037] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:12 2022] DELETE /identity/v3/projects/3c7693bc176d4371b8c2fb45dee7ae04 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:12.966501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:12.968350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:12.983196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fc1ca-4680-4ab9-a018-5c1e6be7f4d6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:13.046148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:13.065986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:13.066756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:13.067645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:13.067986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] PATH_INFO: `/v3/users/67beaf0b2abb4850ad84ae20d7faa937` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:13.069344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67beaf0b2abb4850ad84ae20d7faa937)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:13.071377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:13.146059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67beaf0b2abb4850ad84ae20d7faa937'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.167798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67beaf0b2abb4850ad84ae20d7faa937'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.177879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67beaf0b2abb4850ad84ae20d7faa937'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.178634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67beaf0b2abb4850ad84ae20d7faa937'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.179257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67beaf0b2abb4850ad84ae20d7faa937'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.205223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1024/2038] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:12 2022] DELETE /identity/v3/users/67beaf0b2abb4850ad84ae20d7faa937 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:14.165356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:14.167083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:14.192607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1807ad8-2735-4e96-b15b-aa6166d9d453 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:14.322824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:14.323491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.323782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.324049 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] PATH_INFO: `/v3/projects/bf9e66e3f6f44b759349fc287294acb1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:14.325290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf9e66e3f6f44b759349fc287294acb1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:14.327916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:14.416918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf9e66e3f6f44b759349fc287294acb1', 'request_id': 'req-8d30e341-f357-4176-9532-f699619ff9e8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:14.427674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf9e66e3f6f44b759349fc287294acb1', 'request_id': 'req-8d30e341-f357-4176-9532-f699619ff9e8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:14.442918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf9e66e3f6f44b759349fc287294acb1', 'request_id': 'req-8d30e341-f357-4176-9532-f699619ff9e8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:14.468019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] The token cache is being invalidate because project bf9e66e3f6f44b759349fc287294acb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:14.469871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:14.472677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:14.474978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1015/2039] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:14 2022] DELETE /identity/v3/projects/bf9e66e3f6f44b759349fc287294acb1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:17.587021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:17.588463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:17.645492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f50920-0ef5-43f4-aa37-6f5c73c8cc72 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:17.695166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c534ac-9e58-451a-bc55-345670415bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:17.695713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c534ac-9e58-451a-bc55-345670415bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:17.695994 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c534ac-9e58-451a-bc55-345670415bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:17.696310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c534ac-9e58-451a-bc55-345670415bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:17.698074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-85c534ac-9e58-451a-bc55-345670415bf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:17.738271 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:17.763515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c534ac-9e58-451a-bc55-345670415bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:17.764980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c534ac-9e58-451a-bc55-345670415bf0 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:17.774849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1025/2040] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:18.242874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:18.244303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.277572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:18.311932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30e341-f357-4176-9532-f699619ff9e8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:18.316621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:18.317784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.318064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.318334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] PATH_INFO: `/v3/users/aeb4a5c537b04d0f994b1e4fccabac80` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.319481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb4a5c537b04d0f994b1e4fccabac80)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:18.321417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:18.366703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb4a5c537b04d0f994b1e4fccabac80'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.373697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb4a5c537b04d0f994b1e4fccabac80'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.380728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb4a5c537b04d0f994b1e4fccabac80'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.381351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb4a5c537b04d0f994b1e4fccabac80'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.381946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb4a5c537b04d0f994b1e4fccabac80'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.398805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1016/2041] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:18 2022] DELETE /identity/v3/users/aeb4a5c537b04d0f994b1e4fccabac80 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:18.403559 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980de7-f724-4d3b-9fed-71ed6b29aa8c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.403847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980de7-f724-4d3b-9fed-71ed6b29aa8c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.404119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd980de7-f724-4d3b-9fed-71ed6b29aa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.422385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-fd980de7-f724-4d3b-9fed-71ed6b29aa8c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:18.423583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fd980de7-f724-4d3b-9fed-71ed6b29aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.481112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1026/2042] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:18.491666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:18.493071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.550958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c17e0f-ca44-455f-8eb1-ea29b3f1506a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:18.555210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1022ea-cf40-4b7d-b467-1bc32c8522c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:18.555830 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1022ea-cf40-4b7d-b467-1bc32c8522c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.556114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1022ea-cf40-4b7d-b467-1bc32c8522c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.556419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1022ea-cf40-4b7d-b467-1bc32c8522c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.565536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1022ea-cf40-4b7d-b467-1bc32c8522c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:18.567630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1022ea-cf40-4b7d-b467-1bc32c8522c0 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:18.577123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1017/2043] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:18.887875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980de7-f724-4d3b-9fed-71ed6b29aa8c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:18.889927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fd980de7-f724-4d3b-9fed-71ed6b29aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.917567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd980de7-f724-4d3b-9fed-71ed6b29aa8c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:18.922810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:18.923536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.923900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.924261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] PATH_INFO: `/v3/projects/ed1503406be5400fb58e96c71a885111` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.925487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1503406be5400fb58e96c71a885111)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:18.927527 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:18.982125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1503406be5400fb58e96c71a885111', 'request_id': 'req-cd9fafc7-268e-4e1c-b54f-e076f6abc314'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.988044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1503406be5400fb58e96c71a885111', 'request_id': 'req-cd9fafc7-268e-4e1c-b54f-e076f6abc314'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.996464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1503406be5400fb58e96c71a885111', 'request_id': 'req-cd9fafc7-268e-4e1c-b54f-e076f6abc314'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:19.008054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] The token cache is being invalidate because project ed1503406be5400fb58e96c71a885111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:19.008367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:19.009004 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-cd9fafc7-268e-4e1c-b54f-e076f6abc314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:19.010510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1027/2044] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:18 2022] DELETE /identity/v3/projects/ed1503406be5400fb58e96c71a885111 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:19.015470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b95e9-c6b2-4175-99da-c1d888e0d53d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.015763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b95e9-c6b2-4175-99da-c1d888e0d53d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.016041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b95e9-c6b2-4175-99da-c1d888e0d53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.035987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-285b95e9-c6b2-4175-99da-c1d888e0d53d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:19.037278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-285b95e9-c6b2-4175-99da-c1d888e0d53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.081827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:19.098879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1018/2045] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:19.106948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76209a79-d639-4ded-a9d3-f5ef4a67384f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.107241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76209a79-d639-4ded-a9d3-f5ef4a67384f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.107526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76209a79-d639-4ded-a9d3-f5ef4a67384f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.127693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-76209a79-d639-4ded-a9d3-f5ef4a67384f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:19.128935 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-76209a79-d639-4ded-a9d3-f5ef4a67384f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.137528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1028/2046] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:19.141922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b95e9-c6b2-4175-99da-c1d888e0d53d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.152077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b95e9-c6b2-4175-99da-c1d888e0d53d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.156819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f651837-a263-4d28-bf34-f97af331ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.157523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f651837-a263-4d28-bf34-f97af331ee60 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.157874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f651837-a263-4d28-bf34-f97af331ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.158218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f651837-a263-4d28-bf34-f97af331ee60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.159018 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f651837-a263-4d28-bf34-f97af331ee60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:19.159389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f651837-a263-4d28-bf34-f97af331ee60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.161098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f651837-a263-4d28-bf34-f97af331ee60 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.173003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1019/2047] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:19.178249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76209a79-d639-4ded-a9d3-f5ef4a67384f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.187565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76209a79-d639-4ded-a9d3-f5ef4a67384f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.192812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a5045-4fc1-43e0-aa68-0c59b3963162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.193421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a5045-4fc1-43e0-aa68-0c59b3963162 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.193704 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a5045-4fc1-43e0-aa68-0c59b3963162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.193980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a5045-4fc1-43e0-aa68-0c59b3963162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.194640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a5045-4fc1-43e0-aa68-0c59b3963162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.196590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a5045-4fc1-43e0-aa68-0c59b3963162 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.224220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1029/2048] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:19 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:19.228660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f651837-a263-4d28-bf34-f97af331ee60 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.239490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f651837-a263-4d28-bf34-f97af331ee60 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.314361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479f2a-ad6f-4777-b680-e1aaa4d97c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.315265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479f2a-ad6f-4777-b680-e1aaa4d97c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.315657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479f2a-ad6f-4777-b680-e1aaa4d97c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.315979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a479f2a-ad6f-4777-b680-e1aaa4d97c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.317442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479f2a-ad6f-4777-b680-e1aaa4d97c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.319601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a479f2a-ad6f-4777-b680-e1aaa4d97c65 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.344072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1020/2049] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:19 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:41:19.349387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a5045-4fc1-43e0-aa68-0c59b3963162 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.362690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a5045-4fc1-43e0-aa68-0c59b3963162 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.368848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf0ad0-3408-4050-aea6-518ed1637e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.369552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0ad0-3408-4050-aea6-518ed1637e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.369839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0ad0-3408-4050-aea6-518ed1637e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.370113 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf0ad0-3408-4050-aea6-518ed1637e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.370818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf0ad0-3408-4050-aea6-518ed1637e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.372439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf0ad0-3408-4050-aea6-518ed1637e53 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.383544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1030/2050] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:19.389462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479f2a-ad6f-4777-b680-e1aaa4d97c65 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.399632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a479f2a-ad6f-4777-b680-e1aaa4d97c65 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.405509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f917d-d16f-4925-9609-c4d3a7b26908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.406119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f917d-d16f-4925-9609-c4d3a7b26908 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.406466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f917d-d16f-4925-9609-c4d3a7b26908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.406726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f917d-d16f-4925-9609-c4d3a7b26908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.407419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f917d-d16f-4925-9609-c4d3a7b26908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.409178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f917d-d16f-4925-9609-c4d3a7b26908 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.419957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1021/2051] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:19.424242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf0ad0-3408-4050-aea6-518ed1637e53 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.434478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf0ad0-3408-4050-aea6-518ed1637e53 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.439081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a7b97-b652-4856-b5fe-851567aeb70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.439731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a7b97-b652-4856-b5fe-851567aeb70c admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.440008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a7b97-b652-4856-b5fe-851567aeb70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.440309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a7b97-b652-4856-b5fe-851567aeb70c admin admin] PATH_INFO: `/v3/projects/efd51146ea944484a7cb77ee27fe8bab/users/087ffa5953e048cbad4dfd297ca4355d/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.454842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a7b97-b652-4856-b5fe-851567aeb70c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efd51146ea944484a7cb77ee27fe8bab, user_id=087ffa5953e048cbad4dfd297ca4355d, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.457537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a7b97-b652-4856-b5fe-851567aeb70c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.459678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:19.470638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1031/2052] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:19 2022] PUT /identity/v3/projects/efd51146ea944484a7cb77ee27fe8bab/users/087ffa5953e048cbad4dfd297ca4355d/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:19.481843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baff634-a0b2-44fe-8aa6-b06270d68d58 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.482131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baff634-a0b2-44fe-8aa6-b06270d68d58 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.482408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baff634-a0b2-44fe-8aa6-b06270d68d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.511282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-8baff634-a0b2-44fe-8aa6-b06270d68d58 None None] MFA Rules not processed for user `087ffa5953e048cbad4dfd297ca4355d`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:19.512450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8baff634-a0b2-44fe-8aa6-b06270d68d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.574667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1022/2053] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:19.586674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a7b97-b652-4856-b5fe-851567aeb70c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.588530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ac4a7b97-b652-4856-b5fe-851567aeb70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.645847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a7b97-b652-4856-b5fe-851567aeb70c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.649552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89cc07a-cc6c-4474-a25f-6abe7461737a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.650170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cc07a-cc6c-4474-a25f-6abe7461737a service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.650451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cc07a-cc6c-4474-a25f-6abe7461737a service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.650722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89cc07a-cc6c-4474-a25f-6abe7461737a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.659369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cc07a-cc6c-4474-a25f-6abe7461737a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.661374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89cc07a-cc6c-4474-a25f-6abe7461737a service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.669971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1032/2054] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:27.611028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baff634-a0b2-44fe-8aa6-b06270d68d58 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:27.612504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8baff634-a0b2-44fe-8aa6-b06270d68d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:27.660789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:27.682614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baff634-a0b2-44fe-8aa6-b06270d68d58 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:27.687244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:27.687917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:27.688228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:27.688499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] PATH_INFO: `/v3/users/f14b2953982f450f8e722f1f1cd72860` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:27.689719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f14b2953982f450f8e722f1f1cd72860)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:27.692343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:27.740516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f14b2953982f450f8e722f1f1cd72860'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:27.748555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f14b2953982f450f8e722f1f1cd72860'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:27.756418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f14b2953982f450f8e722f1f1cd72860'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:27.757035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f14b2953982f450f8e722f1f1cd72860'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:27.757638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f14b2953982f450f8e722f1f1cd72860'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:27.774630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1023/2055] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:27 2022] DELETE /identity/v3/users/f14b2953982f450f8e722f1f1cd72860 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:27.779510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147ef3-64bc-48c9-b792-0ac5d7399515 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:27.779959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147ef3-64bc-48c9-b792-0ac5d7399515 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:27.780069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e147ef3-64bc-48c9-b792-0ac5d7399515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:27.799211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2e147ef3-64bc-48c9-b792-0ac5d7399515 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:27.800513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2e147ef3-64bc-48c9-b792-0ac5d7399515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:27.858888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1033/2056] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:27.869378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:27.870808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:27.938714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b68f77-8be2-4879-9b02-a21cee0bab15 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:27.943029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3dbc1-85cf-4844-9c46-06710c107210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:27.943675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3dbc1-85cf-4844-9c46-06710c107210 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:27.943952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3dbc1-85cf-4844-9c46-06710c107210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:27.944266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd3dbc1-85cf-4844-9c46-06710c107210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:27.954304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3dbc1-85cf-4844-9c46-06710c107210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:27.955714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd3dbc1-85cf-4844-9c46-06710c107210 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:27.970575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1024/2057] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:28.255764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e147ef3-64bc-48c9-b792-0ac5d7399515 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:28.257326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2e147ef3-64bc-48c9-b792-0ac5d7399515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:28.270130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e147ef3-64bc-48c9-b792-0ac5d7399515 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:28.274589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:28.275557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:28.275557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:28.276098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] PATH_INFO: `/v3/projects/396083acfc9a4fadb9c8c5585b4bc553` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:28.277611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396083acfc9a4fadb9c8c5585b4bc553)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:28.279597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:28.328044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396083acfc9a4fadb9c8c5585b4bc553', 'request_id': 'req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.334835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396083acfc9a4fadb9c8c5585b4bc553', 'request_id': 'req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.343116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396083acfc9a4fadb9c8c5585b4bc553', 'request_id': 'req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.354794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] The token cache is being invalidate because project 396083acfc9a4fadb9c8c5585b4bc553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:28.355159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.355798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.357347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1034/2058] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:28 2022] DELETE /identity/v3/projects/396083acfc9a4fadb9c8c5585b4bc553 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:28.361280 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3dbc1-85cf-4844-9c46-06710c107210 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:28.371865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd3dbc1-85cf-4844-9c46-06710c107210 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:28.429340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:28.429982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:28.430262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:28.430533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] PATH_INFO: `/v3/users/2aacb512c67245beb29fdd69319af48c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:28.431803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aacb512c67245beb29fdd69319af48c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:28.433737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:28.443466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:28.479842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aacb512c67245beb29fdd69319af48c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.486903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aacb512c67245beb29fdd69319af48c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.493749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aacb512c67245beb29fdd69319af48c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.494414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aacb512c67245beb29fdd69319af48c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.495030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-941edb81-ab70-4960-a0a8-50b6ca6a25d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aacb512c67245beb29fdd69319af48c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.513070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1025/2059] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:28 2022] DELETE /identity/v3/users/2aacb512c67245beb29fdd69319af48c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:28.782742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:28.784195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:28.798452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6d0f5-f2ee-4b07-b761-497c0c573ec6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:28.821650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:28.862604 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:28.863292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:28.864109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:28.864437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] PATH_INFO: `/v3/projects/14868b2d5d46456ea34083deb7122eb3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:28.865636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14868b2d5d46456ea34083deb7122eb3)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:28.867576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:28.912888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14868b2d5d46456ea34083deb7122eb3', 'request_id': 'req-e3c04d5d-16b5-409b-a7c7-1b0db5991682'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.918871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14868b2d5d46456ea34083deb7122eb3', 'request_id': 'req-e3c04d5d-16b5-409b-a7c7-1b0db5991682'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.926009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14868b2d5d46456ea34083deb7122eb3', 'request_id': 'req-e3c04d5d-16b5-409b-a7c7-1b0db5991682'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.935986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] The token cache is being invalidate because project 14868b2d5d46456ea34083deb7122eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:28.936298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.936912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e3c04d5d-16b5-409b-a7c7-1b0db5991682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:28.938397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1035/2060] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:28 2022] DELETE /identity/v3/projects/14868b2d5d46456ea34083deb7122eb3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:28.943630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a797a-f6b1-4392-bc8b-d98cb48e1b0c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:28.944075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a797a-f6b1-4392-bc8b-d98cb48e1b0c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:28.944228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a797a-f6b1-4392-bc8b-d98cb48e1b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:28.963846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ad8a797a-f6b1-4392-bc8b-d98cb48e1b0c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:28.965104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ad8a797a-f6b1-4392-bc8b-d98cb48e1b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:29.025185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1026/2061] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:29.033333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d901d13-f268-4700-8347-ef9013dd4dec None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.033694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d901d13-f268-4700-8347-ef9013dd4dec None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.034003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d901d13-f268-4700-8347-ef9013dd4dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.054265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7d901d13-f268-4700-8347-ef9013dd4dec None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:29.055468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7d901d13-f268-4700-8347-ef9013dd4dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:29.063640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1036/2062] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:29.069246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a797a-f6b1-4392-bc8b-d98cb48e1b0c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.078816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a797a-f6b1-4392-bc8b-d98cb48e1b0c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.084108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc39b8-5797-4794-9b61-640a6ce8517e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.084734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc39b8-5797-4794-9b61-640a6ce8517e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.085017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc39b8-5797-4794-9b61-640a6ce8517e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.085289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc39b8-5797-4794-9b61-640a6ce8517e admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.085982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc39b8-5797-4794-9b61-640a6ce8517e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:29.086286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc39b8-5797-4794-9b61-640a6ce8517e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.087861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc39b8-5797-4794-9b61-640a6ce8517e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.099823 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1027/2063] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:29.103922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d901d13-f268-4700-8347-ef9013dd4dec None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.113239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d901d13-f268-4700-8347-ef9013dd4dec None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.118362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bc87d-4062-437e-a0c4-fcd9849aa4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.118969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc87d-4062-437e-a0c4-fcd9849aa4a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.119276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc87d-4062-437e-a0c4-fcd9849aa4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.119547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bc87d-4062-437e-a0c4-fcd9849aa4a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.120239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bc87d-4062-437e-a0c4-fcd9849aa4a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.122171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bc87d-4062-437e-a0c4-fcd9849aa4a3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.149098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1037/2064] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:29 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:29.153394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc39b8-5797-4794-9b61-640a6ce8517e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.163673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc39b8-5797-4794-9b61-640a6ce8517e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.220074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43176c3-67c1-40e3-ac24-acd4d4dd9313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.220711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43176c3-67c1-40e3-ac24-acd4d4dd9313 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.220998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43176c3-67c1-40e3-ac24-acd4d4dd9313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.221275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43176c3-67c1-40e3-ac24-acd4d4dd9313 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.222296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43176c3-67c1-40e3-ac24-acd4d4dd9313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.225077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43176c3-67c1-40e3-ac24-acd4d4dd9313 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.246236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1028/2065] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:29 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:29.250241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bc87d-4062-437e-a0c4-fcd9849aa4a3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.260462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bc87d-4062-437e-a0c4-fcd9849aa4a3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.265091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9f44-1d04-4031-8116-4def9b52c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.265702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9f44-1d04-4031-8116-4def9b52c045 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.265983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9f44-1d04-4031-8116-4def9b52c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.266254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e9f44-1d04-4031-8116-4def9b52c045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.266948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e9f44-1d04-4031-8116-4def9b52c045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.268572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e9f44-1d04-4031-8116-4def9b52c045 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.278433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1038/2066] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:29.282007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43176c3-67c1-40e3-ac24-acd4d4dd9313 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.288862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:29.293716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43176c3-67c1-40e3-ac24-acd4d4dd9313 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.299654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa34b29-6437-410b-9f2c-28ccae21b14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.300501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34b29-6437-410b-9f2c-28ccae21b14b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.301514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34b29-6437-410b-9f2c-28ccae21b14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.301964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34b29-6437-410b-9f2c-28ccae21b14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.302662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa34b29-6437-410b-9f2c-28ccae21b14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.304316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa34b29-6437-410b-9f2c-28ccae21b14b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.314753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1029/2067] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:29.318858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9f44-1d04-4031-8116-4def9b52c045 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.328739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e9f44-1d04-4031-8116-4def9b52c045 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.333335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5661c-6a01-4414-a746-da2d62bf14bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.333985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5661c-6a01-4414-a746-da2d62bf14bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.334267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5661c-6a01-4414-a746-da2d62bf14bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.334544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5661c-6a01-4414-a746-da2d62bf14bb admin admin] PATH_INFO: `/v3/projects/5130a3d2f7b04e7083b29692af0cef70/users/68a2be4707a04c33a3ecd79f42a94507/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.349317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5661c-6a01-4414-a746-da2d62bf14bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5130a3d2f7b04e7083b29692af0cef70, user_id=68a2be4707a04c33a3ecd79f42a94507, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.352021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5661c-6a01-4414-a746-da2d62bf14bb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.365183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1039/2068] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:29 2022] PUT /identity/v3/projects/5130a3d2f7b04e7083b29692af0cef70/users/68a2be4707a04c33a3ecd79f42a94507/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:29.375344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26638e4-eab0-4c3d-af71-45387bbbe6cb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.375687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26638e4-eab0-4c3d-af71-45387bbbe6cb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.375968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26638e4-eab0-4c3d-af71-45387bbbe6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.404411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f26638e4-eab0-4c3d-af71-45387bbbe6cb None None] MFA Rules not processed for user `68a2be4707a04c33a3ecd79f42a94507`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:29.405627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f26638e4-eab0-4c3d-af71-45387bbbe6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:29.473758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1030/2069] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:29.478169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5661c-6a01-4414-a746-da2d62bf14bb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.527461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:29.542791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5661c-6a01-4414-a746-da2d62bf14bb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.548387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266b8de-821d-4b73-8907-4c1ef75c6c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.549105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266b8de-821d-4b73-8907-4c1ef75c6c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.549451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266b8de-821d-4b73-8907-4c1ef75c6c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.549791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266b8de-821d-4b73-8907-4c1ef75c6c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.550596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266b8de-821d-4b73-8907-4c1ef75c6c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.553286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266b8de-821d-4b73-8907-4c1ef75c6c3e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.579922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1040/2070] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:29 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:41:29.584560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26638e4-eab0-4c3d-af71-45387bbbe6cb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.595949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26638e4-eab0-4c3d-af71-45387bbbe6cb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.651864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb98b4-3c91-4763-975a-55657cdfe89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.652502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb98b4-3c91-4763-975a-55657cdfe89d admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.652786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb98b4-3c91-4763-975a-55657cdfe89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.653056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb98b4-3c91-4763-975a-55657cdfe89d admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.653710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb98b4-3c91-4763-975a-55657cdfe89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.655591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fb98b4-3c91-4763-975a-55657cdfe89d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.675716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1031/2071] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:29 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:29.679767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266b8de-821d-4b73-8907-4c1ef75c6c3e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.690213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266b8de-821d-4b73-8907-4c1ef75c6c3e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.696281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1e0b3-47ae-4e34-aa0c-8ac6fdb6eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.696969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1e0b3-47ae-4e34-aa0c-8ac6fdb6eedf admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.697317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1e0b3-47ae-4e34-aa0c-8ac6fdb6eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.697593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1e0b3-47ae-4e34-aa0c-8ac6fdb6eedf admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.698815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1e0b3-47ae-4e34-aa0c-8ac6fdb6eedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.700723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1e0b3-47ae-4e34-aa0c-8ac6fdb6eedf admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.712695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1041/2072] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:29.716802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb98b4-3c91-4763-975a-55657cdfe89d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.727301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb98b4-3c91-4763-975a-55657cdfe89d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.731854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c73b-c842-407d-a3d9-66c68c7e5382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.732529 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c73b-c842-407d-a3d9-66c68c7e5382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.732807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c73b-c842-407d-a3d9-66c68c7e5382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.733077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162c73b-c842-407d-a3d9-66c68c7e5382 admin admin] PATH_INFO: `/v3/projects/f3d4cdb37c7b4b37a611c616435b3de9/users/9a2b4f7ee84e473ca4089b82714b93f4/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.747993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162c73b-c842-407d-a3d9-66c68c7e5382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d4cdb37c7b4b37a611c616435b3de9, user_id=9a2b4f7ee84e473ca4089b82714b93f4, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.750673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162c73b-c842-407d-a3d9-66c68c7e5382 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.763637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1032/2073] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:29 2022] PUT /identity/v3/projects/f3d4cdb37c7b4b37a611c616435b3de9/users/9a2b4f7ee84e473ca4089b82714b93f4/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:29.767467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1e0b3-47ae-4e34-aa0c-8ac6fdb6eedf admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.778131 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1e0b3-47ae-4e34-aa0c-8ac6fdb6eedf admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.833710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c22d5-d813-4857-b94f-1ac66ecebf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.834327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c22d5-d813-4857-b94f-1ac66ecebf11 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.834585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c22d5-d813-4857-b94f-1ac66ecebf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.834853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c22d5-d813-4857-b94f-1ac66ecebf11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.835539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c22d5-d813-4857-b94f-1ac66ecebf11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.837139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c22d5-d813-4857-b94f-1ac66ecebf11 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.846750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1042/2074] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:29.851636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c73b-c842-407d-a3d9-66c68c7e5382 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.861875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162c73b-c842-407d-a3d9-66c68c7e5382 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.867021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c3d0b-49e4-4cc5-b579-966cc1b5deb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.867681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c3d0b-49e4-4cc5-b579-966cc1b5deb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.867963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c3d0b-49e4-4cc5-b579-966cc1b5deb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.868275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c3d0b-49e4-4cc5-b579-966cc1b5deb8 admin admin] PATH_INFO: `/v3/projects/f3d4cdb37c7b4b37a611c616435b3de9/users/9a2b4f7ee84e473ca4089b82714b93f4/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.870210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c3d0b-49e4-4cc5-b579-966cc1b5deb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d4cdb37c7b4b37a611c616435b3de9, user_id=9a2b4f7ee84e473ca4089b82714b93f4, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.872875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c3d0b-49e4-4cc5-b579-966cc1b5deb8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.882983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1033/2075] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:29 2022] PUT /identity/v3/projects/f3d4cdb37c7b4b37a611c616435b3de9/users/9a2b4f7ee84e473ca4089b82714b93f4/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:29.892894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee3ac-880b-4dd5-87aa-4924f3a27238 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.893185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee3ac-880b-4dd5-87aa-4924f3a27238 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.893464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee3ac-880b-4dd5-87aa-4924f3a27238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.921944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d96ee3ac-880b-4dd5-87aa-4924f3a27238 None None] MFA Rules not processed for user `9a2b4f7ee84e473ca4089b82714b93f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:29.923177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d96ee3ac-880b-4dd5-87aa-4924f3a27238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:29.991907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1043/2076] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:30.002777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c3d0b-49e4-4cc5-b579-966cc1b5deb8 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:30.004996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8a0c3d0b-49e4-4cc5-b579-966cc1b5deb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:30.045745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:30.065090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c3d0b-49e4-4cc5-b579-966cc1b5deb8 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:30.069848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a84fd6d-99eb-4b90-b5f1-81c5e604dd36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:30.070629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84fd6d-99eb-4b90-b5f1-81c5e604dd36 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:30.071103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84fd6d-99eb-4b90-b5f1-81c5e604dd36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:30.071384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84fd6d-99eb-4b90-b5f1-81c5e604dd36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:30.126662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84fd6d-99eb-4b90-b5f1-81c5e604dd36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:30.128099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a84fd6d-99eb-4b90-b5f1-81c5e604dd36 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:30.137622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1034/2077] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:34.267955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ee3ac-880b-4dd5-87aa-4924f3a27238 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:34.269905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d96ee3ac-880b-4dd5-87aa-4924f3a27238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.314624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:34.338849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ee3ac-880b-4dd5-87aa-4924f3a27238 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:34.343306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:34.343945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.344252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.344530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] PATH_INFO: `/v3/users/8ff9746012514273ac5a33f7e91495ed` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:34.345693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff9746012514273ac5a33f7e91495ed)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:34.347779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:34.391908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff9746012514273ac5a33f7e91495ed'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.404092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff9746012514273ac5a33f7e91495ed'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.411324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff9746012514273ac5a33f7e91495ed'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.411974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff9746012514273ac5a33f7e91495ed'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.412606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff9746012514273ac5a33f7e91495ed'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.424771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1044/2078] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:34 2022] DELETE /identity/v3/users/8ff9746012514273ac5a33f7e91495ed => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:34.429459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09da77-7751-4bda-9ed2-46e9a52992bc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.429943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09da77-7751-4bda-9ed2-46e9a52992bc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.430048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09da77-7751-4bda-9ed2-46e9a52992bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:34.448334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9a09da77-7751-4bda-9ed2-46e9a52992bc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:34.449507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9a09da77-7751-4bda-9ed2-46e9a52992bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.506615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1035/2079] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:34.517475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:34.518911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.576609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6ebee-df0b-47ac-bcaa-cff3e1b0d4e2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:34.580248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba292b5-3281-4bad-8213-c873d5f77a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:34.580861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba292b5-3281-4bad-8213-c873d5f77a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.581141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba292b5-3281-4bad-8213-c873d5f77a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.581415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba292b5-3281-4bad-8213-c873d5f77a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:34.590996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba292b5-3281-4bad-8213-c873d5f77a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:34.592395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba292b5-3281-4bad-8213-c873d5f77a55 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:34.601922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1045/2080] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:34.865884 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09da77-7751-4bda-9ed2-46e9a52992bc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:34.867528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9a09da77-7751-4bda-9ed2-46e9a52992bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.882019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09da77-7751-4bda-9ed2-46e9a52992bc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:34.887193 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:34.887844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.888150 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.888430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] PATH_INFO: `/v3/projects/293a59b0807d497dbccd439a4ac0a3a0` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:34.889605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293a59b0807d497dbccd439a4ac0a3a0)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:34.891550 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:34.937684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293a59b0807d497dbccd439a4ac0a3a0', 'request_id': 'req-2e73dff6-ca30-4702-9898-aa85d300d410'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.946278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293a59b0807d497dbccd439a4ac0a3a0', 'request_id': 'req-2e73dff6-ca30-4702-9898-aa85d300d410'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.953508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293a59b0807d497dbccd439a4ac0a3a0', 'request_id': 'req-2e73dff6-ca30-4702-9898-aa85d300d410'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.965078 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] The token cache is being invalidate because project 293a59b0807d497dbccd439a4ac0a3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:34.965514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.966251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.968127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1036/2081] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:34 2022] DELETE /identity/v3/projects/293a59b0807d497dbccd439a4ac0a3a0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:34.971953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba292b5-3281-4bad-8213-c873d5f77a55 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:34.981712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba292b5-3281-4bad-8213-c873d5f77a55 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.038369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.039003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.039279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.039552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] PATH_INFO: `/v3/users/188d03a6444c4b4598446b4c02157c24` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.040724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188d03a6444c4b4598446b4c02157c24)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.042665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.047062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:35.089750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188d03a6444c4b4598446b4c02157c24'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.101445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188d03a6444c4b4598446b4c02157c24'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.108161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188d03a6444c4b4598446b4c02157c24'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.108767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188d03a6444c4b4598446b4c02157c24'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.109370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-56f657dc-cec7-4e9a-bfee-6733c8343440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188d03a6444c4b4598446b4c02157c24'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.125162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1046/2082] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:34 2022] DELETE /identity/v3/users/188d03a6444c4b4598446b4c02157c24 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:35.395648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:35.397211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:35.411742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73dff6-ca30-4702-9898-aa85d300d410 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.421791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:35.469525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.470161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.470420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.470691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] PATH_INFO: `/v3/projects/90498741c0884e529bdaf06183fc61de` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.471875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90498741c0884e529bdaf06183fc61de)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.475314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.521573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90498741c0884e529bdaf06183fc61de', 'request_id': 'req-dcd71b21-e19a-4c0f-922d-9707a10939b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.528949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90498741c0884e529bdaf06183fc61de', 'request_id': 'req-dcd71b21-e19a-4c0f-922d-9707a10939b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.535606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90498741c0884e529bdaf06183fc61de', 'request_id': 'req-dcd71b21-e19a-4c0f-922d-9707a10939b8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.545850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] The token cache is being invalidate because project 90498741c0884e529bdaf06183fc61de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:35.546133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.546758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-dcd71b21-e19a-4c0f-922d-9707a10939b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.548338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1037/2083] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:35 2022] DELETE /identity/v3/projects/90498741c0884e529bdaf06183fc61de => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:35.554837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2c7f3-753b-41a2-8032-14ad54dde4bc None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.555282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2c7f3-753b-41a2-8032-14ad54dde4bc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.555392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2c7f3-753b-41a2-8032-14ad54dde4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.575005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0ed2c7f3-753b-41a2-8032-14ad54dde4bc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:35.576233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0ed2c7f3-753b-41a2-8032-14ad54dde4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:35.635612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1047/2084] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:35.643722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e6fab-10e8-4a6f-b0f8-17f325d1bec7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.644039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e6fab-10e8-4a6f-b0f8-17f325d1bec7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.644831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e6fab-10e8-4a6f-b0f8-17f325d1bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.664858 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-160e6fab-10e8-4a6f-b0f8-17f325d1bec7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:35.666019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-160e6fab-10e8-4a6f-b0f8-17f325d1bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:35.673691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1038/2085] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:35.677696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2c7f3-753b-41a2-8032-14ad54dde4bc None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:35.687400 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2c7f3-753b-41a2-8032-14ad54dde4bc None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.691960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa8fd-1365-497f-a3fc-9e3b78570519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.692602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa8fd-1365-497f-a3fc-9e3b78570519 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.692888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa8fd-1365-497f-a3fc-9e3b78570519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.693173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa8fd-1365-497f-a3fc-9e3b78570519 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.693880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fa8fd-1365-497f-a3fc-9e3b78570519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:35.694189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fa8fd-1365-497f-a3fc-9e3b78570519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.695793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fa8fd-1365-497f-a3fc-9e3b78570519 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.707577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1048/2086] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:35.711615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e6fab-10e8-4a6f-b0f8-17f325d1bec7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:35.720714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e6fab-10e8-4a6f-b0f8-17f325d1bec7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.726016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b9e5-643d-4ab1-8c1d-a58109ad10ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.726610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b9e5-643d-4ab1-8c1d-a58109ad10ac admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.726885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b9e5-643d-4ab1-8c1d-a58109ad10ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.727154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10b9e5-643d-4ab1-8c1d-a58109ad10ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.727806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10b9e5-643d-4ab1-8c1d-a58109ad10ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.729717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10b9e5-643d-4ab1-8c1d-a58109ad10ac admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.758153 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1039/2087] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:35 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:35.762577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa8fd-1365-497f-a3fc-9e3b78570519 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:35.774812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa8fd-1365-497f-a3fc-9e3b78570519 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.834717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7776b-5d7e-4f01-aaba-748580b003c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.835350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7776b-5d7e-4f01-aaba-748580b003c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.835633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7776b-5d7e-4f01-aaba-748580b003c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.835907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7776b-5d7e-4f01-aaba-748580b003c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.836603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7776b-5d7e-4f01-aaba-748580b003c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.838518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7776b-5d7e-4f01-aaba-748580b003c5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.856043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:35.861946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1049/2088] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:35 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:35.866077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b9e5-643d-4ab1-8c1d-a58109ad10ac admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:35.876267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10b9e5-643d-4ab1-8c1d-a58109ad10ac admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.880738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fc53d-d6b3-4e85-9131-12a4606dcafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.881334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fc53d-d6b3-4e85-9131-12a4606dcafc admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.881610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fc53d-d6b3-4e85-9131-12a4606dcafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.881877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824fc53d-d6b3-4e85-9131-12a4606dcafc admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.882562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fc53d-d6b3-4e85-9131-12a4606dcafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.884231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824fc53d-d6b3-4e85-9131-12a4606dcafc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.893988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1040/2089] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:35.898216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7776b-5d7e-4f01-aaba-748580b003c5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:35.908427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7776b-5d7e-4f01-aaba-748580b003c5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.913628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc58123-6cb5-4c7c-8c57-31e6183554ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.914253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc58123-6cb5-4c7c-8c57-31e6183554ee admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.914556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc58123-6cb5-4c7c-8c57-31e6183554ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.914827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc58123-6cb5-4c7c-8c57-31e6183554ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.915516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc58123-6cb5-4c7c-8c57-31e6183554ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.917128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc58123-6cb5-4c7c-8c57-31e6183554ee admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.927395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1050/2090] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:35.931427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fc53d-d6b3-4e85-9131-12a4606dcafc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:35.941818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824fc53d-d6b3-4e85-9131-12a4606dcafc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.946416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0782d-912b-4fc2-a911-ffcce9d8ebf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.947066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0782d-912b-4fc2-a911-ffcce9d8ebf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.947341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0782d-912b-4fc2-a911-ffcce9d8ebf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.947607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0782d-912b-4fc2-a911-ffcce9d8ebf7 admin admin] PATH_INFO: `/v3/projects/f8f3297fa7b545958566881de5dc9c42/users/efc90c2ffb0c490cb3d6cfe849325a34/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.962956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0782d-912b-4fc2-a911-ffcce9d8ebf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f3297fa7b545958566881de5dc9c42, user_id=efc90c2ffb0c490cb3d6cfe849325a34, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.965658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0782d-912b-4fc2-a911-ffcce9d8ebf7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.979126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1041/2091] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:35 2022] PUT /identity/v3/projects/f8f3297fa7b545958566881de5dc9c42/users/efc90c2ffb0c490cb3d6cfe849325a34/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:35.991480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890f63c-247b-4ef1-ba17-1179f4082efe None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.991609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890f63c-247b-4ef1-ba17-1179f4082efe None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.991902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890f63c-247b-4ef1-ba17-1179f4082efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:36.020909 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4890f63c-247b-4ef1-ba17-1179f4082efe None None] MFA Rules not processed for user `efc90c2ffb0c490cb3d6cfe849325a34`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:36.022138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4890f63c-247b-4ef1-ba17-1179f4082efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:36.085230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1051/2092] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:36.096073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0782d-912b-4fc2-a911-ffcce9d8ebf7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:36.097802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dec0782d-912b-4fc2-a911-ffcce9d8ebf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:36.140886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:36.158560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0782d-912b-4fc2-a911-ffcce9d8ebf7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:36.162199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c468e-7626-441a-9683-7eb1d3249668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:36.162811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c468e-7626-441a-9683-7eb1d3249668 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:36.163125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c468e-7626-441a-9683-7eb1d3249668 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:36.163466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c468e-7626-441a-9683-7eb1d3249668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:36.174468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c468e-7626-441a-9683-7eb1d3249668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:36.175892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c468e-7626-441a-9683-7eb1d3249668 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:36.184822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1042/2093] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:39.965734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890f63c-247b-4ef1-ba17-1179f4082efe None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:39.975613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890f63c-247b-4ef1-ba17-1179f4082efe None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:39.979230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabe4c4-ab3c-48e4-a55c-95687b77eb6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:39.979838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabe4c4-ab3c-48e4-a55c-95687b77eb6f service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:39.980124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabe4c4-ab3c-48e4-a55c-95687b77eb6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:39.980430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabe4c4-ab3c-48e4-a55c-95687b77eb6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:39.982207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1dabe4c4-ab3c-48e4-a55c-95687b77eb6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:40.047520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabe4c4-ab3c-48e4-a55c-95687b77eb6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.049131 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabe4c4-ab3c-48e4-a55c-95687b77eb6f service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.059374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1052/2094] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:46.180753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=8 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:46.603357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c468e-7626-441a-9683-7eb1d3249668 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.700237 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c468e-7626-441a-9683-7eb1d3249668 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.708598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.708598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.708598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.708598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] PATH_INFO: `/v3/users/efc90c2ffb0c490cb3d6cfe849325a34` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.708915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efc90c2ffb0c490cb3d6cfe849325a34)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.711029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.791199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efc90c2ffb0c490cb3d6cfe849325a34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.807268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efc90c2ffb0c490cb3d6cfe849325a34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.823221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efc90c2ffb0c490cb3d6cfe849325a34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.824067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efc90c2ffb0c490cb3d6cfe849325a34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.824906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efc90c2ffb0c490cb3d6cfe849325a34'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.846736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1043/2095] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:46 2022] DELETE /identity/v3/users/efc90c2ffb0c490cb3d6cfe849325a34 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:46.851044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd21418-e73e-423d-9831-2c19436a0461 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.851539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd21418-e73e-423d-9831-2c19436a0461 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.851626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd21418-e73e-423d-9831-2c19436a0461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.871558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6cd21418-e73e-423d-9831-2c19436a0461 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:46.872898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6cd21418-e73e-423d-9831-2c19436a0461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.950151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1053/2096] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:46.964553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.966037 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:47.035868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018db59d-1f19-459f-bd70-cbf86b4059f9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.039643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169aafa-6f69-4f99-b641-a7e75c7a735d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.040308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169aafa-6f69-4f99-b641-a7e75c7a735d service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.040590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169aafa-6f69-4f99-b641-a7e75c7a735d service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.041079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169aafa-6f69-4f99-b641-a7e75c7a735d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.050661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169aafa-6f69-4f99-b641-a7e75c7a735d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.052104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169aafa-6f69-4f99-b641-a7e75c7a735d service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.062359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1044/2097] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:41:47.339883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd21418-e73e-423d-9831-2c19436a0461 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.341446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6cd21418-e73e-423d-9831-2c19436a0461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:47.356239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd21418-e73e-423d-9831-2c19436a0461 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.362088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.370420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.370756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.371038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] PATH_INFO: `/v3/projects/f8f3297fa7b545958566881de5dc9c42` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.372421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f3297fa7b545958566881de5dc9c42)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.374369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.382878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:47.426061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f3297fa7b545958566881de5dc9c42', 'request_id': 'req-8de67cae-e259-4a61-917c-8989c73d5697'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:47.433116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f3297fa7b545958566881de5dc9c42', 'request_id': 'req-8de67cae-e259-4a61-917c-8989c73d5697'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:47.441792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f3297fa7b545958566881de5dc9c42', 'request_id': 'req-8de67cae-e259-4a61-917c-8989c73d5697'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:47.455467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] The token cache is being invalidate because project f8f3297fa7b545958566881de5dc9c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:47.455758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:47.456433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-8de67cae-e259-4a61-917c-8989c73d5697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:47.458005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1054/2098] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:47 2022] DELETE /identity/v3/projects/f8f3297fa7b545958566881de5dc9c42 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:47.463374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb2ae8-13d5-4109-afa4-71af096bd83f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.463867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb2ae8-13d5-4109-afa4-71af096bd83f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.463949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb2ae8-13d5-4109-afa4-71af096bd83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.484856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a0fb2ae8-13d5-4109-afa4-71af096bd83f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:47.486075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a0fb2ae8-13d5-4109-afa4-71af096bd83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:47.504828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:47.554149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1045/2099] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:47.561723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45275e60-66c0-448b-8e38-31b6747855bd None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.562015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45275e60-66c0-448b-8e38-31b6747855bd None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.562290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45275e60-66c0-448b-8e38-31b6747855bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.584636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-45275e60-66c0-448b-8e38-31b6747855bd None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:47.587110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-45275e60-66c0-448b-8e38-31b6747855bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:47.596952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1055/2100] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:47.601610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb2ae8-13d5-4109-afa4-71af096bd83f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.613248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb2ae8-13d5-4109-afa4-71af096bd83f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.619675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53180df9-1bda-43d5-a0aa-e31b0e0bc241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.630226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53180df9-1bda-43d5-a0aa-e31b0e0bc241 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.630728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53180df9-1bda-43d5-a0aa-e31b0e0bc241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.631106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53180df9-1bda-43d5-a0aa-e31b0e0bc241 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.633038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53180df9-1bda-43d5-a0aa-e31b0e0bc241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:47.633038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53180df9-1bda-43d5-a0aa-e31b0e0bc241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.634135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53180df9-1bda-43d5-a0aa-e31b0e0bc241 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.653719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1046/2101] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:47.658061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45275e60-66c0-448b-8e38-31b6747855bd None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.668607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45275e60-66c0-448b-8e38-31b6747855bd None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.678370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cc859-6641-46e0-a4f3-ff5983a95280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.679115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cc859-6641-46e0-a4f3-ff5983a95280 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.679399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cc859-6641-46e0-a4f3-ff5983a95280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.679665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cc859-6641-46e0-a4f3-ff5983a95280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.680661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cc859-6641-46e0-a4f3-ff5983a95280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.682319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cc859-6641-46e0-a4f3-ff5983a95280 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.723137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1056/2102] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:41:47.727367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53180df9-1bda-43d5-a0aa-e31b0e0bc241 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.738188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53180df9-1bda-43d5-a0aa-e31b0e0bc241 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.798120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad848b2-7cee-45e1-9fcf-9e753a014731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.798741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad848b2-7cee-45e1-9fcf-9e753a014731 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.799148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad848b2-7cee-45e1-9fcf-9e753a014731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.799426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad848b2-7cee-45e1-9fcf-9e753a014731 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.800108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad848b2-7cee-45e1-9fcf-9e753a014731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.802269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad848b2-7cee-45e1-9fcf-9e753a014731 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.833187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1047/2103] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:47.834266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cc859-6641-46e0-a4f3-ff5983a95280 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.852782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cc859-6641-46e0-a4f3-ff5983a95280 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.858254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dcba1-ca37-4bbc-a66b-2751ee7b90be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.858983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dcba1-ca37-4bbc-a66b-2751ee7b90be admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.859379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dcba1-ca37-4bbc-a66b-2751ee7b90be admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.859760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dcba1-ca37-4bbc-a66b-2751ee7b90be admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.860625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dcba1-ca37-4bbc-a66b-2751ee7b90be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.862382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dcba1-ca37-4bbc-a66b-2751ee7b90be admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.877181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1057/2104] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:47.878588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad848b2-7cee-45e1-9fcf-9e753a014731 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.889647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad848b2-7cee-45e1-9fcf-9e753a014731 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.898410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af6f47-c918-4a53-871d-bed647e91338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.899040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af6f47-c918-4a53-871d-bed647e91338 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.899325 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af6f47-c918-4a53-871d-bed647e91338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.899599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af6f47-c918-4a53-871d-bed647e91338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.900339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af6f47-c918-4a53-871d-bed647e91338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.902366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09af6f47-c918-4a53-871d-bed647e91338 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.914427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1048/2105] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:47.918601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dcba1-ca37-4bbc-a66b-2751ee7b90be admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.931725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dcba1-ca37-4bbc-a66b-2751ee7b90be admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.936547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bc483-dc26-42ca-b463-f620e6d6eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.937220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bc483-dc26-42ca-b463-f620e6d6eea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.937503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bc483-dc26-42ca-b463-f620e6d6eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.937779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bc483-dc26-42ca-b463-f620e6d6eea6 admin admin] PATH_INFO: `/v3/projects/f98870499e274cdc8451a2a4216a4cbe/users/ac0c8efc0b3e44ec83bce1426bf73887/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.954715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bc483-dc26-42ca-b463-f620e6d6eea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f98870499e274cdc8451a2a4216a4cbe, user_id=ac0c8efc0b3e44ec83bce1426bf73887, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.957483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bc483-dc26-42ca-b463-f620e6d6eea6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.977585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1058/2106] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:47 2022] PUT /identity/v3/projects/f98870499e274cdc8451a2a4216a4cbe/users/ac0c8efc0b3e44ec83bce1426bf73887/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:47.987804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc23f4-349b-47c7-af60-7d4690708243 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.988093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc23f4-349b-47c7-af60-7d4690708243 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.988404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc23f4-349b-47c7-af60-7d4690708243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.046268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-1cfc23f4-349b-47c7-af60-7d4690708243 None None] MFA Rules not processed for user `ac0c8efc0b3e44ec83bce1426bf73887`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:48.047866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1cfc23f4-349b-47c7-af60-7d4690708243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:48.190058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1049/2107] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:48.203062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bc483-dc26-42ca-b463-f620e6d6eea6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:48.205583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fe2bc483-dc26-42ca-b463-f620e6d6eea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:48.305889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bc483-dc26-42ca-b463-f620e6d6eea6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:48.310748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3126dad-77e1-4470-a270-705fe14107e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cd62eb975492aab4a136c0e9825a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:48.312448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126dad-77e1-4470-a270-705fe14107e6 service glance] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.312686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126dad-77e1-4470-a270-705fe14107e6 service glance] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.312953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126dad-77e1-4470-a270-705fe14107e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.330796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3126dad-77e1-4470-a270-705fe14107e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:48.332621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3126dad-77e1-4470-a270-705fe14107e6 service glance] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:48.347802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1059/2108] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:49.829366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f6d1f-1f73-4b42-93fc-8cd88088346c None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:49.829851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f6d1f-1f73-4b42-93fc-8cd88088346c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:49.829961 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f6d1f-1f73-4b42-93fc-8cd88088346c None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:49.831270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1050/2109] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:41:49.841265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835068d1-d678-4b29-aedc-ddca8f32bb57 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:49.841717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835068d1-d678-4b29-aedc-ddca8f32bb57 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:49.841972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835068d1-d678-4b29-aedc-ddca8f32bb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:49.864574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-835068d1-d678-4b29-aedc-ddca8f32bb57 None None] MFA Rules not processed for user `ad52cba0b761482d96b6659654034ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:49.865887 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-835068d1-d678-4b29-aedc-ddca8f32bb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:49.907489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:49.943728 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1060/2110] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:41:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:50.094144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f6d1f-1f73-4b42-93fc-8cd88088346c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:50.095983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-012f6d1f-1f73-4b42-93fc-8cd88088346c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:50.114417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f6d1f-1f73-4b42-93fc-8cd88088346c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:50.120373 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4452-0e7c-486e-9fc7-e902d7dd63e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:50.121058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4452-0e7c-486e-9fc7-e902d7dd63e9 service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.121344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4452-0e7c-486e-9fc7-e902d7dd63e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.121642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad4452-0e7c-486e-9fc7-e902d7dd63e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.128649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835068d1-d678-4b29-aedc-ddca8f32bb57 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:50.130239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-835068d1-d678-4b29-aedc-ddca8f32bb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:50.131362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad4452-0e7c-486e-9fc7-e902d7dd63e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:50.133490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad4452-0e7c-486e-9fc7-e902d7dd63e9 service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:50.144349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1051/2111] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:50.198874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835068d1-d678-4b29-aedc-ddca8f32bb57 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:50.203630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:50.204309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.204587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.204863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] PATH_INFO: `/v3/users/4e09723da5824c2e8d7321d84a4b6bf4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.206019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e09723da5824c2e8d7321d84a4b6bf4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:50.207948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:50.252596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e09723da5824c2e8d7321d84a4b6bf4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.265381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e09723da5824c2e8d7321d84a4b6bf4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.272995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e09723da5824c2e8d7321d84a4b6bf4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.274139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e09723da5824c2e8d7321d84a4b6bf4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.274925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-009c92e2-53e9-49c7-b8fc-1dee9d93c944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e09723da5824c2e8d7321d84a4b6bf4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.289184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1061/2112] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:50 2022] DELETE /identity/v3/users/4e09723da5824c2e8d7321d84a4b6bf4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:50.465801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4452-0e7c-486e-9fc7-e902d7dd63e9 service placement] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:50.472277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:50.477055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad4452-0e7c-486e-9fc7-e902d7dd63e9 service placement] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:50.541057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:50.541675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.541952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.542217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] PATH_INFO: `/v3/projects/80128fa0bb36449682b56634f82e78b2` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.543341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80128fa0bb36449682b56634f82e78b2)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:50.545275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:50.591158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80128fa0bb36449682b56634f82e78b2', 'request_id': 'req-14676ef5-aef4-4fcb-925a-6a9658739103'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.597930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80128fa0bb36449682b56634f82e78b2', 'request_id': 'req-14676ef5-aef4-4fcb-925a-6a9658739103'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.603962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80128fa0bb36449682b56634f82e78b2', 'request_id': 'req-14676ef5-aef4-4fcb-925a-6a9658739103'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.614202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] The token cache is being invalidate because project 80128fa0bb36449682b56634f82e78b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:50.614422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.615043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-14676ef5-aef4-4fcb-925a-6a9658739103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:50.617086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1052/2113] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:50 2022] DELETE /identity/v3/projects/80128fa0bb36449682b56634f82e78b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:50.622354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687961d4-6b5c-4cbd-843f-d0cfcf13631b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.622673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687961d4-6b5c-4cbd-843f-d0cfcf13631b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.622977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687961d4-6b5c-4cbd-843f-d0cfcf13631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.644439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-687961d4-6b5c-4cbd-843f-d0cfcf13631b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:50.645670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-687961d4-6b5c-4cbd-843f-d0cfcf13631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:50.689292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:50.707749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1062/2114] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:50.715970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e7a7-cd4b-436a-9910-681f04acd144 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.716372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e7a7-cd4b-436a-9910-681f04acd144 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.716717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796e7a7-cd4b-436a-9910-681f04acd144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.736418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c796e7a7-cd4b-436a-9910-681f04acd144 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:50.737676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c796e7a7-cd4b-436a-9910-681f04acd144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:50.746438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1053/2115] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:50.750952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687961d4-6b5c-4cbd-843f-d0cfcf13631b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:50.762854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687961d4-6b5c-4cbd-843f-d0cfcf13631b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:50.769049 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91b27d-cb67-4072-9376-d46fc415dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:50.769672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91b27d-cb67-4072-9376-d46fc415dddc admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.769949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91b27d-cb67-4072-9376-d46fc415dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.770217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91b27d-cb67-4072-9376-d46fc415dddc admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.770914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91b27d-cb67-4072-9376-d46fc415dddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:50.771216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91b27d-cb67-4072-9376-d46fc415dddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:50.772888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a91b27d-cb67-4072-9376-d46fc415dddc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:50.785380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1063/2116] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:50.789567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796e7a7-cd4b-436a-9910-681f04acd144 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:50.800233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796e7a7-cd4b-436a-9910-681f04acd144 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:50.806194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87bfd9-e2f5-49b4-81f2-4772b0ae5cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:50.806819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87bfd9-e2f5-49b4-81f2-4772b0ae5cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.807100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87bfd9-e2f5-49b4-81f2-4772b0ae5cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.807371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87bfd9-e2f5-49b4-81f2-4772b0ae5cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.808043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87bfd9-e2f5-49b4-81f2-4772b0ae5cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:50.810043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf87bfd9-e2f5-49b4-81f2-4772b0ae5cd9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:50.837627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1054/2117] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:50 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:50.841774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91b27d-cb67-4072-9376-d46fc415dddc admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:50.851774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91b27d-cb67-4072-9376-d46fc415dddc admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:50.910457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fc68e-4ec8-4223-9391-169727bd5b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:50.910999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fc68e-4ec8-4223-9391-169727bd5b16 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.911280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fc68e-4ec8-4223-9391-169727bd5b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.911556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4fc68e-4ec8-4223-9391-169727bd5b16 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.912267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fc68e-4ec8-4223-9391-169727bd5b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:50.914807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4fc68e-4ec8-4223-9391-169727bd5b16 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:50.936987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1064/2118] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:50 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:50.941089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87bfd9-e2f5-49b4-81f2-4772b0ae5cd9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:50.951319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87bfd9-e2f5-49b4-81f2-4772b0ae5cd9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:50.955955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2856553-8ad9-4efd-b08c-0c67cc5349e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:50.956595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2856553-8ad9-4efd-b08c-0c67cc5349e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.956879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2856553-8ad9-4efd-b08c-0c67cc5349e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.957154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2856553-8ad9-4efd-b08c-0c67cc5349e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.957851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2856553-8ad9-4efd-b08c-0c67cc5349e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:50.959431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2856553-8ad9-4efd-b08c-0c67cc5349e9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:50.969344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1055/2119] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:50.973332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fc68e-4ec8-4223-9391-169727bd5b16 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:50.983768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4fc68e-4ec8-4223-9391-169727bd5b16 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:50.988571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bceb17-ecb3-4087-a5ba-33eda7c476c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:50.989185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bceb17-ecb3-4087-a5ba-33eda7c476c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:50.989470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bceb17-ecb3-4087-a5ba-33eda7c476c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:50.989746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bceb17-ecb3-4087-a5ba-33eda7c476c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:50.990443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bceb17-ecb3-4087-a5ba-33eda7c476c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:50.992759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bceb17-ecb3-4087-a5ba-33eda7c476c2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:51.003161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1065/2120] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:51.007114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2856553-8ad9-4efd-b08c-0c67cc5349e9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:51.016818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2856553-8ad9-4efd-b08c-0c67cc5349e9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:51.021328 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f11af1-44f3-4ea0-9a60-236e3d42e33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:51.021975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11af1-44f3-4ea0-9a60-236e3d42e33d admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:51.022290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11af1-44f3-4ea0-9a60-236e3d42e33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:51.022567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f11af1-44f3-4ea0-9a60-236e3d42e33d admin admin] PATH_INFO: `/v3/projects/ad2873976b194c2daf265f84f5e60519/users/c9f838395a2247e49e0acacd0fdadb2b/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:51.037253 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f11af1-44f3-4ea0-9a60-236e3d42e33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2873976b194c2daf265f84f5e60519, user_id=c9f838395a2247e49e0acacd0fdadb2b, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:51.040424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f11af1-44f3-4ea0-9a60-236e3d42e33d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:51.052702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1056/2121] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:51 2022] PUT /identity/v3/projects/ad2873976b194c2daf265f84f5e60519/users/c9f838395a2247e49e0acacd0fdadb2b/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:51.058206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cd82e-e1b5-4dd3-a8a0-53d8c6959962 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:51.058498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cd82e-e1b5-4dd3-a8a0-53d8c6959962 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:51.058807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2cd82e-e1b5-4dd3-a8a0-53d8c6959962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:51.078442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ce2cd82e-e1b5-4dd3-a8a0-53d8c6959962 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:51.079664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ce2cd82e-e1b5-4dd3-a8a0-53d8c6959962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:51.137568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1066/2122] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:51.147139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f11af1-44f3-4ea0-9a60-236e3d42e33d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:51.148852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-99f11af1-44f3-4ea0-9a60-236e3d42e33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:51.183416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:51.207328 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f11af1-44f3-4ea0-9a60-236e3d42e33d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:51.211254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a9e455-5e1a-4db2-bd62-874ffc2fa4f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:51.211867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e455-5e1a-4db2-bd62-874ffc2fa4f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:51.212162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e455-5e1a-4db2-bd62-874ffc2fa4f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:51.212452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a9e455-5e1a-4db2-bd62-874ffc2fa4f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:51.221595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e455-5e1a-4db2-bd62-874ffc2fa4f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:51.223013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a9e455-5e1a-4db2-bd62-874ffc2fa4f3 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:51.233218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1057/2123] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:55.049456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c175ce-fe3c-4faa-89d5-bca40a332c35 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:55.050035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c175ce-fe3c-4faa-89d5-bca40a332c35 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:55.050035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c175ce-fe3c-4faa-89d5-bca40a332c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:55.086742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-10c175ce-fe3c-4faa-89d5-bca40a332c35 None None] MFA Rules not processed for user `c9f838395a2247e49e0acacd0fdadb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:55.087942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-10c175ce-fe3c-4faa-89d5-bca40a332c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:55.147836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:55.174152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1067/2124] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:55.184680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514972b1-fc47-47ac-8e0b-d83a4955419c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:55.185225 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514972b1-fc47-47ac-8e0b-d83a4955419c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:55.185436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514972b1-fc47-47ac-8e0b-d83a4955419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:55.218181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-514972b1-fc47-47ac-8e0b-d83a4955419c None None] MFA Rules not processed for user `c9f838395a2247e49e0acacd0fdadb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:55.219441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-514972b1-fc47-47ac-8e0b-d83a4955419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:55.230870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1058/2125] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:55.237753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c175ce-fe3c-4faa-89d5-bca40a332c35 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:55.239359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-10c175ce-fe3c-4faa-89d5-bca40a332c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:55.322777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c175ce-fe3c-4faa-89d5-bca40a332c35 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:55.328246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426c40-6a07-4687-9041-7bdeb018c180 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:55.328868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426c40-6a07-4687-9041-7bdeb018c180 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:55.329147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426c40-6a07-4687-9041-7bdeb018c180 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:55.329463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21426c40-6a07-4687-9041-7bdeb018c180 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:55.337926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21426c40-6a07-4687-9041-7bdeb018c180 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:55.339534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21426c40-6a07-4687-9041-7bdeb018c180 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:55.352201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1068/2126] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:56.309119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779cb13-676c-4554-bc3c-f57e6a792d1e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:56.310557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779cb13-676c-4554-bc3c-f57e6a792d1e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:56.311215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779cb13-676c-4554-bc3c-f57e6a792d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:56.332732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a779cb13-676c-4554-bc3c-f57e6a792d1e None None] MFA Rules not processed for user `c9f838395a2247e49e0acacd0fdadb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:56.333948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a779cb13-676c-4554-bc3c-f57e6a792d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:56.344538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1059/2127] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:41:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:05.344725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=40 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:06.327172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=18 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:08.193331 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426c40-6a07-4687-9041-7bdeb018c180 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:08.194744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-21426c40-6a07-4687-9041-7bdeb018c180 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:08.207896 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21426c40-6a07-4687-9041-7bdeb018c180 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:08.212387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:08.213011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:08.213290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:08.213562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] PATH_INFO: `/v3/users/087ffa5953e048cbad4dfd297ca4355d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:08.214707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=087ffa5953e048cbad4dfd297ca4355d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:08.216729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:08.265921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '087ffa5953e048cbad4dfd297ca4355d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.278437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '087ffa5953e048cbad4dfd297ca4355d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.285168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '087ffa5953e048cbad4dfd297ca4355d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.285873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '087ffa5953e048cbad4dfd297ca4355d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.286483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '087ffa5953e048cbad4dfd297ca4355d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.299955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1069/2128] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:08 2022] DELETE /identity/v3/users/087ffa5953e048cbad4dfd297ca4355d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:08.305706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223c9ee-27b6-4ad6-8c42-f3d1aad15dc2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:08.306251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223c9ee-27b6-4ad6-8c42-f3d1aad15dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:08.306350 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223c9ee-27b6-4ad6-8c42-f3d1aad15dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:08.325032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f223c9ee-27b6-4ad6-8c42-f3d1aad15dc2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:08.326281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f223c9ee-27b6-4ad6-8c42-f3d1aad15dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:08.385904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1060/2129] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:08.395663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:08.397132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:08.454318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baf9a8-3a17-4fad-88c2-2e04834fc15b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:08.457862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7ea9d-001d-4ffa-8a9d-867fdb02abdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:08.458485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7ea9d-001d-4ffa-8a9d-867fdb02abdd service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:08.458774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7ea9d-001d-4ffa-8a9d-867fdb02abdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:08.459047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7ea9d-001d-4ffa-8a9d-867fdb02abdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:08.467877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7ea9d-001d-4ffa-8a9d-867fdb02abdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:08.469354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d7ea9d-001d-4ffa-8a9d-867fdb02abdd service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:08.482421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1070/2130] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:08.752650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223c9ee-27b6-4ad6-8c42-f3d1aad15dc2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:08.754325 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f223c9ee-27b6-4ad6-8c42-f3d1aad15dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:08.766788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223c9ee-27b6-4ad6-8c42-f3d1aad15dc2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:08.774117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:08.774329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:08.774608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:08.774969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] PATH_INFO: `/v3/projects/efd51146ea944484a7cb77ee27fe8bab` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:08.782026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efd51146ea944484a7cb77ee27fe8bab)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:08.785324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:08.842862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efd51146ea944484a7cb77ee27fe8bab', 'request_id': 'req-fe54e55a-3784-42be-9a19-df2920952777'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.854898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efd51146ea944484a7cb77ee27fe8bab', 'request_id': 'req-fe54e55a-3784-42be-9a19-df2920952777'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.861526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efd51146ea944484a7cb77ee27fe8bab', 'request_id': 'req-fe54e55a-3784-42be-9a19-df2920952777'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.872630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] The token cache is being invalidate because project efd51146ea944484a7cb77ee27fe8bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:08.872924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.873595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-fe54e55a-3784-42be-9a19-df2920952777 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:08.875125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1061/2131] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:08 2022] DELETE /identity/v3/projects/efd51146ea944484a7cb77ee27fe8bab => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:08.879942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e552ead-9705-4201-afb4-0ac18e75b446 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:08.880257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e552ead-9705-4201-afb4-0ac18e75b446 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:08.881085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e552ead-9705-4201-afb4-0ac18e75b446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:08.901691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6e552ead-9705-4201-afb4-0ac18e75b446 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:08.902884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6e552ead-9705-4201-afb4-0ac18e75b446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:08.966879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1071/2132] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:08.979956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9d20b-c0f2-491e-9ffc-87793cad041c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:08.979956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9d20b-c0f2-491e-9ffc-87793cad041c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:08.979956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9d20b-c0f2-491e-9ffc-87793cad041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:08.998597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-83d9d20b-c0f2-491e-9ffc-87793cad041c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:09.000345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-83d9d20b-c0f2-491e-9ffc-87793cad041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:09.009580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1062/2133] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:09.013889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e552ead-9705-4201-afb4-0ac18e75b446 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:09.024361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e552ead-9705-4201-afb4-0ac18e75b446 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:09.029412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e9535-d497-4ae5-88a0-87ed4d7f7b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:09.030042 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e9535-d497-4ae5-88a0-87ed4d7f7b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:09.030329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e9535-d497-4ae5-88a0-87ed4d7f7b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:09.030777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e9535-d497-4ae5-88a0-87ed4d7f7b47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:09.031480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e9535-d497-4ae5-88a0-87ed4d7f7b47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:09.031788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e9535-d497-4ae5-88a0-87ed4d7f7b47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:09.033667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e9535-d497-4ae5-88a0-87ed4d7f7b47 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:09.052097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1072/2134] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:09.053622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9d20b-c0f2-491e-9ffc-87793cad041c None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:09.062732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9d20b-c0f2-491e-9ffc-87793cad041c None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:09.069984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb0341-c763-4ed2-89e7-2137aa72f52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:09.070960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0341-c763-4ed2-89e7-2137aa72f52c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:09.071396 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0341-c763-4ed2-89e7-2137aa72f52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:09.071715 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb0341-c763-4ed2-89e7-2137aa72f52c admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:09.072789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb0341-c763-4ed2-89e7-2137aa72f52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:09.076750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb0341-c763-4ed2-89e7-2137aa72f52c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:09.110664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1063/2135] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:09 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:09.116195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e9535-d497-4ae5-88a0-87ed4d7f7b47 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:09.120753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:09.127575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e9535-d497-4ae5-88a0-87ed4d7f7b47 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:09.191152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5b9d9-c5ff-4c17-a162-c78f97335b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:09.191747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5b9d9-c5ff-4c17-a162-c78f97335b94 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:09.192026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5b9d9-c5ff-4c17-a162-c78f97335b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:09.192364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5b9d9-c5ff-4c17-a162-c78f97335b94 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:09.193477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5b9d9-c5ff-4c17-a162-c78f97335b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:09.195418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5b9d9-c5ff-4c17-a162-c78f97335b94 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:09.225903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1073/2136] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:09 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:09.230024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb0341-c763-4ed2-89e7-2137aa72f52c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:09.240644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb0341-c763-4ed2-89e7-2137aa72f52c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:09.245289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57d18d-8b68-4fbc-9bcf-bc3b6736eb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:09.245894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57d18d-8b68-4fbc-9bcf-bc3b6736eb04 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:09.246173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57d18d-8b68-4fbc-9bcf-bc3b6736eb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:09.246442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57d18d-8b68-4fbc-9bcf-bc3b6736eb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:09.247160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57d18d-8b68-4fbc-9bcf-bc3b6736eb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:09.248857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57d18d-8b68-4fbc-9bcf-bc3b6736eb04 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:09.259197 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1064/2137] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:09.263153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5b9d9-c5ff-4c17-a162-c78f97335b94 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:09.273760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5b9d9-c5ff-4c17-a162-c78f97335b94 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:09.278614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe1c5f-bac2-45c2-8f38-e78c8ffd07e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:09.279216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1c5f-bac2-45c2-8f38-e78c8ffd07e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:09.279499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1c5f-bac2-45c2-8f38-e78c8ffd07e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:09.279777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe1c5f-bac2-45c2-8f38-e78c8ffd07e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:09.280512 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe1c5f-bac2-45c2-8f38-e78c8ffd07e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:09.282107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe1c5f-bac2-45c2-8f38-e78c8ffd07e5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:09.292424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1074/2138] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:09.296578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57d18d-8b68-4fbc-9bcf-bc3b6736eb04 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:09.308572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57d18d-8b68-4fbc-9bcf-bc3b6736eb04 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:09.313221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c10ba9-c060-47ac-a832-b37a8fbb786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:09.313874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c10ba9-c060-47ac-a832-b37a8fbb786c admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:09.314158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c10ba9-c060-47ac-a832-b37a8fbb786c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:09.314439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c10ba9-c060-47ac-a832-b37a8fbb786c admin admin] PATH_INFO: `/v3/projects/0e8eaba7492c4315b5f71046d74a5d42/users/134161c5d1b8497bb31387cdc4d56420/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:09.329264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c10ba9-c060-47ac-a832-b37a8fbb786c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8eaba7492c4315b5f71046d74a5d42, user_id=134161c5d1b8497bb31387cdc4d56420, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:09.331905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c10ba9-c060-47ac-a832-b37a8fbb786c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:09.344943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1065/2139] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:09 2022] PUT /identity/v3/projects/0e8eaba7492c4315b5f71046d74a5d42/users/134161c5d1b8497bb31387cdc4d56420/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:09.356231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebf6d-e0d6-4209-bdd8-fae2111aa000 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:09.356522 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebf6d-e0d6-4209-bdd8-fae2111aa000 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:09.356802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eebf6d-e0d6-4209-bdd8-fae2111aa000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:09.384706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-35eebf6d-e0d6-4209-bdd8-fae2111aa000 None None] MFA Rules not processed for user `134161c5d1b8497bb31387cdc4d56420`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:09.385946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-35eebf6d-e0d6-4209-bdd8-fae2111aa000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:09.449325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1075/2140] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:09.459991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c10ba9-c060-47ac-a832-b37a8fbb786c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:09.461710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f2c10ba9-c060-47ac-a832-b37a8fbb786c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:09.483498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:09.521694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c10ba9-c060-47ac-a832-b37a8fbb786c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:09.525305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788b3a1-a3e7-48f3-bc62-339d1ef195cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:09.526597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b3a1-a3e7-48f3-bc62-339d1ef195cd service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:09.526878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b3a1-a3e7-48f3-bc62-339d1ef195cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:09.527154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788b3a1-a3e7-48f3-bc62-339d1ef195cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:09.540775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788b3a1-a3e7-48f3-bc62-339d1ef195cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:09.542202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788b3a1-a3e7-48f3-bc62-339d1ef195cd service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:09.554309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1066/2141] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:19.446147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:19.548547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=17 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:29.199536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eebf6d-e0d6-4209-bdd8-fae2111aa000 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:29.201148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-35eebf6d-e0d6-4209-bdd8-fae2111aa000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:29.278814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eebf6d-e0d6-4209-bdd8-fae2111aa000 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:29.284205 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:29.284854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:29.285134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:29.285446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] PATH_INFO: `/v3/users/68a2be4707a04c33a3ecd79f42a94507` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:29.286639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] RBAC: Authorizing `identity:delete_user(user_id=68a2be4707a04c33a3ecd79f42a94507)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:29.289253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:29.347049 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68a2be4707a04c33a3ecd79f42a94507'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.363505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68a2be4707a04c33a3ecd79f42a94507'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.371463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68a2be4707a04c33a3ecd79f42a94507'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.372246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68a2be4707a04c33a3ecd79f42a94507'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.372953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68a2be4707a04c33a3ecd79f42a94507'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.388714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1076/2142] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:29 2022] DELETE /identity/v3/users/68a2be4707a04c33a3ecd79f42a94507 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:29.393794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90a6dc-aeb1-469c-a29d-d890d6f4fb86 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:29.394262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90a6dc-aeb1-469c-a29d-d890d6f4fb86 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:29.394564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90a6dc-aeb1-469c-a29d-d890d6f4fb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:29.418658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9b90a6dc-aeb1-469c-a29d-d890d6f4fb86 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:29.420247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9b90a6dc-aeb1-469c-a29d-d890d6f4fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:29.481218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1067/2143] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:29.491180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:29.492639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:29.549576 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b098b1c-6e23-4970-ab8a-3ccce96f652c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:29.553195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63be38-836d-4784-88f7-57cee3f8343d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:29.553805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63be38-836d-4784-88f7-57cee3f8343d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:29.554087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63be38-836d-4784-88f7-57cee3f8343d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:29.554362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63be38-836d-4784-88f7-57cee3f8343d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:29.563332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63be38-836d-4784-88f7-57cee3f8343d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:29.564805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63be38-836d-4784-88f7-57cee3f8343d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:29.574332 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1077/2144] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:29.839449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90a6dc-aeb1-469c-a29d-d890d6f4fb86 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:29.840925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9b90a6dc-aeb1-469c-a29d-d890d6f4fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:29.855876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90a6dc-aeb1-469c-a29d-d890d6f4fb86 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:29.860567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:29.861209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:29.861504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:29.861779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] PATH_INFO: `/v3/projects/5130a3d2f7b04e7083b29692af0cef70` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:29.862940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5130a3d2f7b04e7083b29692af0cef70)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:29.864879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:29.912534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5130a3d2f7b04e7083b29692af0cef70', 'request_id': 'req-0f41f06c-593c-484e-bbb2-24526b761ce1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.919909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5130a3d2f7b04e7083b29692af0cef70', 'request_id': 'req-0f41f06c-593c-484e-bbb2-24526b761ce1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.926057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5130a3d2f7b04e7083b29692af0cef70', 'request_id': 'req-0f41f06c-593c-484e-bbb2-24526b761ce1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.937096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] The token cache is being invalidate because project 5130a3d2f7b04e7083b29692af0cef70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:29.937382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.938177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:29.939815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1068/2145] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:29 2022] DELETE /identity/v3/projects/5130a3d2f7b04e7083b29692af0cef70 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:29.944258 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63be38-836d-4784-88f7-57cee3f8343d service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:29.955650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63be38-836d-4784-88f7-57cee3f8343d service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:29.974107 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:30.013362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:30.013999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.014280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.014555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] PATH_INFO: `/v3/users/9a2b4f7ee84e473ca4089b82714b93f4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.015715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2b4f7ee84e473ca4089b82714b93f4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:30.017701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:30.075693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2b4f7ee84e473ca4089b82714b93f4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.089387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2b4f7ee84e473ca4089b82714b93f4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.096436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2b4f7ee84e473ca4089b82714b93f4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.097134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2b4f7ee84e473ca4089b82714b93f4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.097733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-c80d7ea1-815a-4bf9-9c0a-c9e4dafe3176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2b4f7ee84e473ca4089b82714b93f4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.110344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1078/2146] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:29 2022] DELETE /identity/v3/users/9a2b4f7ee84e473ca4089b82714b93f4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:30.458689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:30.460509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:30.474613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41f06c-593c-484e-bbb2-24526b761ce1 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:30.531397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:30.532024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.532331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.532603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] PATH_INFO: `/v3/projects/f3d4cdb37c7b4b37a611c616435b3de9` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.533736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d4cdb37c7b4b37a611c616435b3de9)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:30.535617 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:30.564788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:30.582297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d4cdb37c7b4b37a611c616435b3de9', 'request_id': 'req-8067c855-601e-4d51-9593-8730e38f220e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.589457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d4cdb37c7b4b37a611c616435b3de9', 'request_id': 'req-8067c855-601e-4d51-9593-8730e38f220e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.595709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d4cdb37c7b4b37a611c616435b3de9', 'request_id': 'req-8067c855-601e-4d51-9593-8730e38f220e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.607025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] The token cache is being invalidate because project f3d4cdb37c7b4b37a611c616435b3de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:30.607305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.607924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8067c855-601e-4d51-9593-8730e38f220e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.609492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1069/2147] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:30 2022] DELETE /identity/v3/projects/f3d4cdb37c7b4b37a611c616435b3de9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:30.614450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75487e46-e30f-492e-aa09-258f77473d51 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.614884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75487e46-e30f-492e-aa09-258f77473d51 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.615020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75487e46-e30f-492e-aa09-258f77473d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.634617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-75487e46-e30f-492e-aa09-258f77473d51 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:30.635807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-75487e46-e30f-492e-aa09-258f77473d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:30.692838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1079/2148] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:30.701047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afe75d-1311-494c-8ce6-be381b43a901 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.701338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afe75d-1311-494c-8ce6-be381b43a901 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.701619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afe75d-1311-494c-8ce6-be381b43a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.721264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-93afe75d-1311-494c-8ce6-be381b43a901 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:30.722561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-93afe75d-1311-494c-8ce6-be381b43a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:30.731111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1070/2149] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:30.735178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75487e46-e30f-492e-aa09-258f77473d51 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:30.745538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75487e46-e30f-492e-aa09-258f77473d51 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:30.750206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b28e6-4535-49f7-9b14-af5be693fb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:30.750811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b28e6-4535-49f7-9b14-af5be693fb50 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.751090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b28e6-4535-49f7-9b14-af5be693fb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.751361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b28e6-4535-49f7-9b14-af5be693fb50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.752094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b28e6-4535-49f7-9b14-af5be693fb50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:30.752438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b28e6-4535-49f7-9b14-af5be693fb50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:30.754039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b28e6-4535-49f7-9b14-af5be693fb50 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:30.765209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1080/2150] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:30.769260 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afe75d-1311-494c-8ce6-be381b43a901 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:30.778601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afe75d-1311-494c-8ce6-be381b43a901 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:30.783126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70811e1-b7de-45aa-b215-6001ee61c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:30.783714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70811e1-b7de-45aa-b215-6001ee61c440 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.783989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70811e1-b7de-45aa-b215-6001ee61c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.784289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70811e1-b7de-45aa-b215-6001ee61c440 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.784953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70811e1-b7de-45aa-b215-6001ee61c440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:30.786828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70811e1-b7de-45aa-b215-6001ee61c440 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:30.814583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1071/2151] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:30 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:30.818959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b28e6-4535-49f7-9b14-af5be693fb50 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:30.829042 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b28e6-4535-49f7-9b14-af5be693fb50 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:30.854634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:30.886121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f0985-ede8-4bb5-836e-75754274430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:30.886732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f0985-ede8-4bb5-836e-75754274430b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.887009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f0985-ede8-4bb5-836e-75754274430b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.887278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f0985-ede8-4bb5-836e-75754274430b admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.887930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f0985-ede8-4bb5-836e-75754274430b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:30.889888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f0985-ede8-4bb5-836e-75754274430b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:30.910273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1081/2152] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:30 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:30.914788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70811e1-b7de-45aa-b215-6001ee61c440 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:30.924846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70811e1-b7de-45aa-b215-6001ee61c440 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:30.930230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7187ef-2bd1-4d59-8b80-dfb8c83cd7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:30.930827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7187ef-2bd1-4d59-8b80-dfb8c83cd7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.931104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7187ef-2bd1-4d59-8b80-dfb8c83cd7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.931373 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7187ef-2bd1-4d59-8b80-dfb8c83cd7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.932061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7187ef-2bd1-4d59-8b80-dfb8c83cd7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:30.933666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7187ef-2bd1-4d59-8b80-dfb8c83cd7b6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:30.943327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1072/2153] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:30.947262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f0985-ede8-4bb5-836e-75754274430b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:30.957325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f0985-ede8-4bb5-836e-75754274430b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:30.962780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e81dbc-7dfb-4390-8254-9518aee89fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:30.963384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e81dbc-7dfb-4390-8254-9518aee89fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.963690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e81dbc-7dfb-4390-8254-9518aee89fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.963969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e81dbc-7dfb-4390-8254-9518aee89fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.964703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e81dbc-7dfb-4390-8254-9518aee89fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:30.966338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e81dbc-7dfb-4390-8254-9518aee89fb2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:30.977423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1082/2154] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:30.981347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7187ef-2bd1-4d59-8b80-dfb8c83cd7b6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:30.991013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7187ef-2bd1-4d59-8b80-dfb8c83cd7b6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:30.995528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec2aab-c003-4dda-83c7-ccc9a224ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:30.996191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec2aab-c003-4dda-83c7-ccc9a224ea97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.996468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec2aab-c003-4dda-83c7-ccc9a224ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.996738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec2aab-c003-4dda-83c7-ccc9a224ea97 admin admin] PATH_INFO: `/v3/projects/a8b7ccc24dbe465c9b71f9a25bbdd05d/users/85473a4efaa14be0abf032108df70ee5/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.010608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec2aab-c003-4dda-83c7-ccc9a224ea97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8b7ccc24dbe465c9b71f9a25bbdd05d, user_id=85473a4efaa14be0abf032108df70ee5, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.013256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec2aab-c003-4dda-83c7-ccc9a224ea97 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.027123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1073/2155] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:30 2022] PUT /identity/v3/projects/a8b7ccc24dbe465c9b71f9a25bbdd05d/users/85473a4efaa14be0abf032108df70ee5/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:42:31.037111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a745-6a30-49f6-80e0-d487c80e51e5 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.037931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a745-6a30-49f6-80e0-d487c80e51e5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.038203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2a745-6a30-49f6-80e0-d487c80e51e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.064538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f9e2a745-6a30-49f6-80e0-d487c80e51e5 None None] MFA Rules not processed for user `85473a4efaa14be0abf032108df70ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:31.065722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f9e2a745-6a30-49f6-80e0-d487c80e51e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:31.129797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1083/2156] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:31.134251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec2aab-c003-4dda-83c7-ccc9a224ea97 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.199198 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec2aab-c003-4dda-83c7-ccc9a224ea97 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.203868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302734c-889a-4975-b034-528c5b497fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.204520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302734c-889a-4975-b034-528c5b497fea admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.204805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302734c-889a-4975-b034-528c5b497fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.205083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302734c-889a-4975-b034-528c5b497fea admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.205762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302734c-889a-4975-b034-528c5b497fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.207718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302734c-889a-4975-b034-528c5b497fea admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.234332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1074/2157] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:31 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:42:31.238407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a745-6a30-49f6-80e0-d487c80e51e5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.249087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2a745-6a30-49f6-80e0-d487c80e51e5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.305369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e85d4-7ada-4cd5-a478-9936b1a133c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.306001 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e85d4-7ada-4cd5-a478-9936b1a133c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.306283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e85d4-7ada-4cd5-a478-9936b1a133c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.306557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e85d4-7ada-4cd5-a478-9936b1a133c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.307244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e85d4-7ada-4cd5-a478-9936b1a133c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.309206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e85d4-7ada-4cd5-a478-9936b1a133c2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.330097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1084/2158] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:31 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:31.334548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302734c-889a-4975-b034-528c5b497fea admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.344714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302734c-889a-4975-b034-528c5b497fea admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.349199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd11b46-07fd-40ff-9f41-43383d45e2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.350418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd11b46-07fd-40ff-9f41-43383d45e2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.350694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd11b46-07fd-40ff-9f41-43383d45e2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.350962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd11b46-07fd-40ff-9f41-43383d45e2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.351645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd11b46-07fd-40ff-9f41-43383d45e2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.353290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd11b46-07fd-40ff-9f41-43383d45e2c5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.364578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1075/2159] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:31.368620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e85d4-7ada-4cd5-a478-9936b1a133c2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.378434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e85d4-7ada-4cd5-a478-9936b1a133c2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.383577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9daee-398c-4c4f-bdf6-77725ac7e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.384229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9daee-398c-4c4f-bdf6-77725ac7e400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.384508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9daee-398c-4c4f-bdf6-77725ac7e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.384828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def9daee-398c-4c4f-bdf6-77725ac7e400 admin admin] PATH_INFO: `/v3/projects/4461bef1522443508b0923110e70d38d/users/c4ebfbe4de234313b23a1cfc24a882bc/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.399410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9daee-398c-4c4f-bdf6-77725ac7e400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4461bef1522443508b0923110e70d38d, user_id=c4ebfbe4de234313b23a1cfc24a882bc, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.402342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def9daee-398c-4c4f-bdf6-77725ac7e400 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.415237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1085/2160] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:31 2022] PUT /identity/v3/projects/4461bef1522443508b0923110e70d38d/users/c4ebfbe4de234313b23a1cfc24a882bc/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:31.419170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd11b46-07fd-40ff-9f41-43383d45e2c5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.429724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd11b46-07fd-40ff-9f41-43383d45e2c5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.449776 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:31.488780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba335e6-5d0a-4986-96fa-6d2d91cd7656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.489430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba335e6-5d0a-4986-96fa-6d2d91cd7656 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.489599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba335e6-5d0a-4986-96fa-6d2d91cd7656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.489878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba335e6-5d0a-4986-96fa-6d2d91cd7656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.491240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba335e6-5d0a-4986-96fa-6d2d91cd7656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.492885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba335e6-5d0a-4986-96fa-6d2d91cd7656 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.506009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1076/2161] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:42:31.507270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9daee-398c-4c4f-bdf6-77725ac7e400 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.512776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:31.519027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def9daee-398c-4c4f-bdf6-77725ac7e400 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.524622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67462098-5dac-4803-8ff7-ef7a8263448d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.525606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67462098-5dac-4803-8ff7-ef7a8263448d admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.525886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67462098-5dac-4803-8ff7-ef7a8263448d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.526188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67462098-5dac-4803-8ff7-ef7a8263448d admin admin] PATH_INFO: `/v3/projects/4461bef1522443508b0923110e70d38d/users/c4ebfbe4de234313b23a1cfc24a882bc/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.528158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67462098-5dac-4803-8ff7-ef7a8263448d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4461bef1522443508b0923110e70d38d, user_id=c4ebfbe4de234313b23a1cfc24a882bc, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.530819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67462098-5dac-4803-8ff7-ef7a8263448d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.542119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1086/2162] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:31 2022] PUT /identity/v3/projects/4461bef1522443508b0923110e70d38d/users/c4ebfbe4de234313b23a1cfc24a882bc/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:31.553847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f273d-e999-447d-b1cb-5954926bc0d3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.554136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f273d-e999-447d-b1cb-5954926bc0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.554414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f273d-e999-447d-b1cb-5954926bc0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.584749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0c0f273d-e999-447d-b1cb-5954926bc0d3 None None] MFA Rules not processed for user `c4ebfbe4de234313b23a1cfc24a882bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:31.585974 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0c0f273d-e999-447d-b1cb-5954926bc0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:31.653039 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1077/2163] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:31.665598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67462098-5dac-4803-8ff7-ef7a8263448d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.667340 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-67462098-5dac-4803-8ff7-ef7a8263448d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:31.723253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67462098-5dac-4803-8ff7-ef7a8263448d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.727582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5192-6670-41aa-ae50-5e02f3f06117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.728217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5192-6670-41aa-ae50-5e02f3f06117 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.728524 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5192-6670-41aa-ae50-5e02f3f06117 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.728793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b5192-6670-41aa-ae50-5e02f3f06117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.737511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b5192-6670-41aa-ae50-5e02f3f06117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.738999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b5192-6670-41aa-ae50-5e02f3f06117 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.748106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1087/2164] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:32.050240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f273d-e999-447d-b1cb-5954926bc0d3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.059780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f273d-e999-447d-b1cb-5954926bc0d3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.064359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a434f4-353a-49f8-9c5d-ecad6acd45a3 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4ebfbe4de234313b23a1cfc24a882bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461bef1522443508b0923110e70d38d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.065097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a434f4-353a-49f8-9c5d-ecad6acd45a3 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.065390 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a434f4-353a-49f8-9c5d-ecad6acd45a3 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.065675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a434f4-353a-49f8-9c5d-ecad6acd45a3 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.066377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a434f4-353a-49f8-9c5d-ecad6acd45a3 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:32.066688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a434f4-353a-49f8-9c5d-ecad6acd45a3 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.068326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a434f4-353a-49f8-9c5d-ecad6acd45a3 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.080341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1078/2165] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:32.084289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5192-6670-41aa-ae50-5e02f3f06117 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.095523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b5192-6670-41aa-ae50-5e02f3f06117 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.101761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d63d32-cc8a-4b6e-8244-a47bb453ecee tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4ebfbe4de234313b23a1cfc24a882bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461bef1522443508b0923110e70d38d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.102612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d63d32-cc8a-4b6e-8244-a47bb453ecee tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.102899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d63d32-cc8a-4b6e-8244-a47bb453ecee tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.103175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d63d32-cc8a-4b6e-8244-a47bb453ecee tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.104074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d63d32-cc8a-4b6e-8244-a47bb453ecee tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.106558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d63d32-cc8a-4b6e-8244-a47bb453ecee tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.133536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1088/2166] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:32 2022] POST /identity/v3/projects => generated 355 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:32.137790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a434f4-353a-49f8-9c5d-ecad6acd45a3 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.147938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a434f4-353a-49f8-9c5d-ecad6acd45a3 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.205703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4ebfbe4de234313b23a1cfc24a882bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461bef1522443508b0923110e70d38d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.206322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.206606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.206908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.207596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:32.207902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.209567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.221162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1079/2167] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:32.261624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d63d32-cc8a-4b6e-8244-a47bb453ecee tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.271760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d63d32-cc8a-4b6e-8244-a47bb453ecee tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.276633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4ebfbe4de234313b23a1cfc24a882bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4461bef1522443508b0923110e70d38d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.277273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.277554 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.277826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] PATH_INFO: `/v3/projects/52d20076d8b74a90af3e9ad493f1d864` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.278971 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Authorizing `identity:delete_project(project_id=52d20076d8b74a90af3e9ad493f1d864)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.280911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.326404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d20076d8b74a90af3e9ad493f1d864', 'request_id': 'req-e71c11d0-59f9-47e1-8e7b-5245ab160f42'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.332758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d20076d8b74a90af3e9ad493f1d864', 'request_id': 'req-e71c11d0-59f9-47e1-8e7b-5245ab160f42'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.340774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d20076d8b74a90af3e9ad493f1d864', 'request_id': 'req-e71c11d0-59f9-47e1-8e7b-5245ab160f42'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.351442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] The token cache is being invalidate because project 52d20076d8b74a90af3e9ad493f1d864 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:32.351729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.352392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e71c11d0-59f9-47e1-8e7b-5245ab160f42 tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.353903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1089/2168] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:32 2022] DELETE /identity/v3/projects/52d20076d8b74a90af3e9ad493f1d864 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:32.555913 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.557737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:32.588050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:32.623501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af08b29-b295-4959-8276-f915765849dd tempest-VolumeQuotaClassesTest-560468301 tempest-VolumeQuotaClassesTest-560468301-project-admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.681951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.682587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.682882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.683155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] PATH_INFO: `/v3/users/85473a4efaa14be0abf032108df70ee5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.684370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=85473a4efaa14be0abf032108df70ee5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.686290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.739430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85473a4efaa14be0abf032108df70ee5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.747542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85473a4efaa14be0abf032108df70ee5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.756165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85473a4efaa14be0abf032108df70ee5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.756829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85473a4efaa14be0abf032108df70ee5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.757695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85473a4efaa14be0abf032108df70ee5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.775895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1080/2169] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:32 2022] DELETE /identity/v3/users/85473a4efaa14be0abf032108df70ee5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:32.780198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a32db-1238-47ec-9844-28c414e6d053 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.780667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a32db-1238-47ec-9844-28c414e6d053 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.780775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a32db-1238-47ec-9844-28c414e6d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.800321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-949a32db-1238-47ec-9844-28c414e6d053 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:32.801482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-949a32db-1238-47ec-9844-28c414e6d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:32.847359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:32.861100 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1090/2170] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:32.871100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.872552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:32.932029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb355ba1-85fc-4c5a-a2bd-d033a0830a3c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.935690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308d4cd-4645-4020-9276-3e88522dda4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.936345 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308d4cd-4645-4020-9276-3e88522dda4d service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.936627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308d4cd-4645-4020-9276-3e88522dda4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.936901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308d4cd-4645-4020-9276-3e88522dda4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.944229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:32.946629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308d4cd-4645-4020-9276-3e88522dda4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.948594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308d4cd-4645-4020-9276-3e88522dda4d service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.960251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1081/2171] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:33.228150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a32db-1238-47ec-9844-28c414e6d053 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:33.229862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-949a32db-1238-47ec-9844-28c414e6d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:33.242682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a32db-1238-47ec-9844-28c414e6d053 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:33.247672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:33.248353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:33.248639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:33.248916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] PATH_INFO: `/v3/projects/a8b7ccc24dbe465c9b71f9a25bbdd05d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:33.250103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8b7ccc24dbe465c9b71f9a25bbdd05d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:33.252272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:33.301417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8b7ccc24dbe465c9b71f9a25bbdd05d', 'request_id': 'req-7c169296-79bf-4abb-b5e3-f4f642f39065'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.308466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8b7ccc24dbe465c9b71f9a25bbdd05d', 'request_id': 'req-7c169296-79bf-4abb-b5e3-f4f642f39065'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.315435 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8b7ccc24dbe465c9b71f9a25bbdd05d', 'request_id': 'req-7c169296-79bf-4abb-b5e3-f4f642f39065'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.326677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] The token cache is being invalidate because project a8b7ccc24dbe465c9b71f9a25bbdd05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:33.326957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.327577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.329117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1091/2172] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:33 2022] DELETE /identity/v3/projects/a8b7ccc24dbe465c9b71f9a25bbdd05d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:33.333024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308d4cd-4645-4020-9276-3e88522dda4d service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:33.342726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308d4cd-4645-4020-9276-3e88522dda4d service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:33.399019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:33.399652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:33.400216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:33.400505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] PATH_INFO: `/v3/users/c4ebfbe4de234313b23a1cfc24a882bc` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:33.401695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ebfbe4de234313b23a1cfc24a882bc)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:33.403618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:33.450199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ebfbe4de234313b23a1cfc24a882bc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.456934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ebfbe4de234313b23a1cfc24a882bc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.464535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ebfbe4de234313b23a1cfc24a882bc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.465146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ebfbe4de234313b23a1cfc24a882bc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.465749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-93b70f08-38ca-4efe-b525-2f2559018684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ebfbe4de234313b23a1cfc24a882bc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.483571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1082/2173] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:33 2022] DELETE /identity/v3/users/c4ebfbe4de234313b23a1cfc24a882bc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:33.749410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:33.750895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:33.768049 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c169296-79bf-4abb-b5e3-f4f642f39065 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:33.830293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:33.832347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:33.832644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:33.832980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] PATH_INFO: `/v3/projects/4461bef1522443508b0923110e70d38d` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:33.834270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4461bef1522443508b0923110e70d38d)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:33.836239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:33.886456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4461bef1522443508b0923110e70d38d', 'request_id': 'req-08898269-acd4-4ac0-8f3f-4c43411cbbd8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.892530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4461bef1522443508b0923110e70d38d', 'request_id': 'req-08898269-acd4-4ac0-8f3f-4c43411cbbd8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.901187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4461bef1522443508b0923110e70d38d', 'request_id': 'req-08898269-acd4-4ac0-8f3f-4c43411cbbd8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.912561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] The token cache is being invalidate because project 4461bef1522443508b0923110e70d38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:33.912850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.913511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-08898269-acd4-4ac0-8f3f-4c43411cbbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:33.915046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1092/2174] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:33 2022] DELETE /identity/v3/projects/4461bef1522443508b0923110e70d38d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:33.919904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1680c-ad20-45e6-b9db-b70a1c52e2e1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:33.920409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1680c-ad20-45e6-b9db-b70a1c52e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:33.920498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1680c-ad20-45e6-b9db-b70a1c52e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:33.941497 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dab1680c-ad20-45e6-b9db-b70a1c52e2e1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:33.942762 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dab1680c-ad20-45e6-b9db-b70a1c52e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:34.000713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1083/2175] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:34.008976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5c0f4-0ad5-433c-bdcf-b4c722f76ca4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.009260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5c0f4-0ad5-433c-bdcf-b4c722f76ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.009532 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5c0f4-0ad5-433c-bdcf-b4c722f76ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.023941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:34.029783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f5a5c0f4-0ad5-433c-bdcf-b4c722f76ca4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:34.031631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f5a5c0f4-0ad5-433c-bdcf-b4c722f76ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:34.040397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1093/2176] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:34.044554 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1680c-ad20-45e6-b9db-b70a1c52e2e1 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.054630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1680c-ad20-45e6-b9db-b70a1c52e2e1 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.059235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc47296-c804-4d97-8891-6f37cbce8817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.059923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc47296-c804-4d97-8891-6f37cbce8817 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.060467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc47296-c804-4d97-8891-6f37cbce8817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.060959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc47296-c804-4d97-8891-6f37cbce8817 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.061925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc47296-c804-4d97-8891-6f37cbce8817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:34.062234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc47296-c804-4d97-8891-6f37cbce8817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.063843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc47296-c804-4d97-8891-6f37cbce8817 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.077553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1084/2177] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:34.082135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5c0f4-0ad5-433c-bdcf-b4c722f76ca4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.091305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5c0f4-0ad5-433c-bdcf-b4c722f76ca4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.095925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc152c-bf54-4fe6-a83d-1a2ba710030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.096570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc152c-bf54-4fe6-a83d-1a2ba710030d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.096849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc152c-bf54-4fe6-a83d-1a2ba710030d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.097118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc152c-bf54-4fe6-a83d-1a2ba710030d admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.097787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc152c-bf54-4fe6-a83d-1a2ba710030d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.099686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc152c-bf54-4fe6-a83d-1a2ba710030d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.127378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1094/2178] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:34 2022] POST /identity/v3/projects => generated 401 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:34.132290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc47296-c804-4d97-8891-6f37cbce8817 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.137432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:34.143598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc47296-c804-4d97-8891-6f37cbce8817 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.202319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d694adb-843b-4f30-8970-a93f9130defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.202926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d694adb-843b-4f30-8970-a93f9130defc admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.203200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d694adb-843b-4f30-8970-a93f9130defc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.203467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d694adb-843b-4f30-8970-a93f9130defc admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.204181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d694adb-843b-4f30-8970-a93f9130defc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.206068 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d694adb-843b-4f30-8970-a93f9130defc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.227054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1085/2179] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:34 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:42:34.231183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc152c-bf54-4fe6-a83d-1a2ba710030d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.241987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc152c-bf54-4fe6-a83d-1a2ba710030d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.246845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625a7ba-fc7c-4a45-a169-815aa56c1aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.247455 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625a7ba-fc7c-4a45-a169-815aa56c1aad admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.247740 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625a7ba-fc7c-4a45-a169-815aa56c1aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.248015 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625a7ba-fc7c-4a45-a169-815aa56c1aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.248767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625a7ba-fc7c-4a45-a169-815aa56c1aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.250451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625a7ba-fc7c-4a45-a169-815aa56c1aad admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.260910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1095/2180] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:34.264695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d694adb-843b-4f30-8970-a93f9130defc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.275475 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d694adb-843b-4f30-8970-a93f9130defc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.279977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a3406-2c20-45a2-9062-f49eef302dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.280618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a3406-2c20-45a2-9062-f49eef302dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.280895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a3406-2c20-45a2-9062-f49eef302dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.281167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a3406-2c20-45a2-9062-f49eef302dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.281857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a3406-2c20-45a2-9062-f49eef302dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.283424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a3406-2c20-45a2-9062-f49eef302dc6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.294334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1086/2181] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:34.298468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625a7ba-fc7c-4a45-a169-815aa56c1aad admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.309328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625a7ba-fc7c-4a45-a169-815aa56c1aad admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.314045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776254bb-3544-45e1-abfe-d17ae02668b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.314797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776254bb-3544-45e1-abfe-d17ae02668b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.315140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776254bb-3544-45e1-abfe-d17ae02668b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.315476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776254bb-3544-45e1-abfe-d17ae02668b6 admin admin] PATH_INFO: `/v3/projects/667c92f0d752417380f9754de3debc53/users/5e2fdfb7dc294d98aba1d0d252c9db03/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.330282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776254bb-3544-45e1-abfe-d17ae02668b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=667c92f0d752417380f9754de3debc53, user_id=5e2fdfb7dc294d98aba1d0d252c9db03, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.332998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776254bb-3544-45e1-abfe-d17ae02668b6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.345421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1096/2182] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:34 2022] PUT /identity/v3/projects/667c92f0d752417380f9754de3debc53/users/5e2fdfb7dc294d98aba1d0d252c9db03/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:34.357165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72100-6a2d-4188-853a-946a415e7b82 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.357445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72100-6a2d-4188-853a-946a415e7b82 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.357717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc72100-6a2d-4188-853a-946a415e7b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.386443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4cc72100-6a2d-4188-853a-946a415e7b82 None None] MFA Rules not processed for user `5e2fdfb7dc294d98aba1d0d252c9db03`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:34.387822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4cc72100-6a2d-4188-853a-946a415e7b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:34.464966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1087/2183] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:34 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:34.469574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776254bb-3544-45e1-abfe-d17ae02668b6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.529797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776254bb-3544-45e1-abfe-d17ae02668b6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.534426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94389929-4c85-475f-908a-04293eff4d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.535030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94389929-4c85-475f-908a-04293eff4d86 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.535310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94389929-4c85-475f-908a-04293eff4d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.535579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94389929-4c85-475f-908a-04293eff4d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.536284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94389929-4c85-475f-908a-04293eff4d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.538786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94389929-4c85-475f-908a-04293eff4d86 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.565278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1097/2184] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:34 2022] POST /identity/v3/projects => generated 401 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:34.569252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc72100-6a2d-4188-853a-946a415e7b82 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.579958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc72100-6a2d-4188-853a-946a415e7b82 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.636170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29478-5352-4c5f-a1bb-829ef4e850b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.636725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29478-5352-4c5f-a1bb-829ef4e850b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.637007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29478-5352-4c5f-a1bb-829ef4e850b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.637280 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e29478-5352-4c5f-a1bb-829ef4e850b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.637978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e29478-5352-4c5f-a1bb-829ef4e850b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.639885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e29478-5352-4c5f-a1bb-829ef4e850b2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.656398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:34.661730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1088/2185] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:34 2022] POST /identity/v3/users => generated 307 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:34.666181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94389929-4c85-475f-908a-04293eff4d86 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.676519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94389929-4c85-475f-908a-04293eff4d86 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.681665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff535d3f-5222-4f8d-943c-b43bc13a7643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.682276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff535d3f-5222-4f8d-943c-b43bc13a7643 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.682560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff535d3f-5222-4f8d-943c-b43bc13a7643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.682838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff535d3f-5222-4f8d-943c-b43bc13a7643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.683538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff535d3f-5222-4f8d-943c-b43bc13a7643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.685186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff535d3f-5222-4f8d-943c-b43bc13a7643 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.695373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1098/2186] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:42:34.699196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29478-5352-4c5f-a1bb-829ef4e850b2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.709844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e29478-5352-4c5f-a1bb-829ef4e850b2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.714519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3e0f-030e-48b2-8a44-f80bd2e31f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.715178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3e0f-030e-48b2-8a44-f80bd2e31f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.715459 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3e0f-030e-48b2-8a44-f80bd2e31f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.715730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd3e0f-030e-48b2-8a44-f80bd2e31f93 admin admin] PATH_INFO: `/v3/projects/a6ec6efcc0d24583a97edf93ff40bb5a/users/a6983551fb1647c9a0df04c4905c0503/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.730833 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd3e0f-030e-48b2-8a44-f80bd2e31f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ec6efcc0d24583a97edf93ff40bb5a, user_id=a6983551fb1647c9a0df04c4905c0503, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.733534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd3e0f-030e-48b2-8a44-f80bd2e31f93 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.745861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1089/2187] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:34 2022] PUT /identity/v3/projects/a6ec6efcc0d24583a97edf93ff40bb5a/users/a6983551fb1647c9a0df04c4905c0503/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:34.749736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff535d3f-5222-4f8d-943c-b43bc13a7643 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.759449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff535d3f-5222-4f8d-943c-b43bc13a7643 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.815697 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00043d-92e3-4a8e-bf43-61850351a818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.816397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00043d-92e3-4a8e-bf43-61850351a818 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.816685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00043d-92e3-4a8e-bf43-61850351a818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.816963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00043d-92e3-4a8e-bf43-61850351a818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.817655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00043d-92e3-4a8e-bf43-61850351a818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.819264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00043d-92e3-4a8e-bf43-61850351a818 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.829045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1099/2188] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:34.833089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3e0f-030e-48b2-8a44-f80bd2e31f93 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.843661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd3e0f-030e-48b2-8a44-f80bd2e31f93 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.848114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb99c-16a7-491d-b5b8-597f1bb4612c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.848784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb99c-16a7-491d-b5b8-597f1bb4612c admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.849059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb99c-16a7-491d-b5b8-597f1bb4612c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.849333 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb99c-16a7-491d-b5b8-597f1bb4612c admin admin] PATH_INFO: `/v3/projects/a6ec6efcc0d24583a97edf93ff40bb5a/users/a6983551fb1647c9a0df04c4905c0503/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.851861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdb99c-16a7-491d-b5b8-597f1bb4612c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ec6efcc0d24583a97edf93ff40bb5a, user_id=a6983551fb1647c9a0df04c4905c0503, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.854866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccdb99c-16a7-491d-b5b8-597f1bb4612c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.865321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1090/2189] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:34 2022] PUT /identity/v3/projects/a6ec6efcc0d24583a97edf93ff40bb5a/users/a6983551fb1647c9a0df04c4905c0503/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:34.875195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7633f-cc16-4652-a325-41fdc43cb621 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.875671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7633f-cc16-4652-a325-41fdc43cb621 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.875762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7633f-cc16-4652-a325-41fdc43cb621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.901406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:34.904754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-03a7633f-cc16-4652-a325-41fdc43cb621 None None] MFA Rules not processed for user `a6983551fb1647c9a0df04c4905c0503`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:34.906704 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-03a7633f-cc16-4652-a325-41fdc43cb621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:34.976087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1100/2190] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:34 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:34.986700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb99c-16a7-491d-b5b8-597f1bb4612c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.988613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cccdb99c-16a7-491d-b5b8-597f1bb4612c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:35.048950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdb99c-16a7-491d-b5b8-597f1bb4612c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.052631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68e2fd-83dc-4f04-9d0b-17b006487a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.053254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68e2fd-83dc-4f04-9d0b-17b006487a7c service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.053542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68e2fd-83dc-4f04-9d0b-17b006487a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.053817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68e2fd-83dc-4f04-9d0b-17b006487a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.063417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68e2fd-83dc-4f04-9d0b-17b006487a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.064959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68e2fd-83dc-4f04-9d0b-17b006487a7c service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.074627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1091/2191] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:34 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:35.156235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7633f-cc16-4652-a325-41fdc43cb621 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:35.166002 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7633f-cc16-4652-a325-41fdc43cb621 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.169560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e4cca-26d5-4038-b17b-933c52ae8f59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.170160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4cca-26d5-4038-b17b-933c52ae8f59 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.170437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4cca-26d5-4038-b17b-933c52ae8f59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.170706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e4cca-26d5-4038-b17b-933c52ae8f59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.227299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4cca-26d5-4038-b17b-933c52ae8f59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.228838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3e4cca-26d5-4038-b17b-933c52ae8f59 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.237539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1101/2192] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:35 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:42:41.486863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68e2fd-83dc-4f04-9d0b-17b006487a7c service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:41.550124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68e2fd-83dc-4f04-9d0b-17b006487a7c service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:41.555840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:41.556522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:41.556803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:41.557078 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] PATH_INFO: `/v3/users/5e2fdfb7dc294d98aba1d0d252c9db03` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:41.558404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2fdfb7dc294d98aba1d0d252c9db03)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:41.560501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:41.622138 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2fdfb7dc294d98aba1d0d252c9db03'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:41.630602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2fdfb7dc294d98aba1d0d252c9db03'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:41.642586 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2fdfb7dc294d98aba1d0d252c9db03'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:41.643310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2fdfb7dc294d98aba1d0d252c9db03'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:41.643983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2fdfb7dc294d98aba1d0d252c9db03'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:41.649243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:41.666848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1092/2193] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:41 2022] DELETE /identity/v3/users/5e2fdfb7dc294d98aba1d0d252c9db03 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:41.671313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3a61c-e503-405c-9756-7c42a9f0053b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:41.671807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3a61c-e503-405c-9756-7c42a9f0053b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:41.671927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3a61c-e503-405c-9756-7c42a9f0053b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:41.691488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2fd3a61c-e503-405c-9756-7c42a9f0053b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:41.692775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2fd3a61c-e503-405c-9756-7c42a9f0053b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:41.756321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1102/2194] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:41.766122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:41.767763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:41.829242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a903c-ac4f-4610-b566-3c7c84321152 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:41.832888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8af96-8fad-4263-bc5f-6af229b393c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:41.833536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8af96-8fad-4263-bc5f-6af229b393c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:41.833817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8af96-8fad-4263-bc5f-6af229b393c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:41.834089 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8af96-8fad-4263-bc5f-6af229b393c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:41.843058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8af96-8fad-4263-bc5f-6af229b393c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:41.844523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8af96-8fad-4263-bc5f-6af229b393c5 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:41.854387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1093/2195] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:42.134087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3a61c-e503-405c-9756-7c42a9f0053b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:42.135569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2fd3a61c-e503-405c-9756-7c42a9f0053b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:42.147680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3a61c-e503-405c-9756-7c42a9f0053b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:42.153766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:42.154588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:42.154942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:42.155283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] PATH_INFO: `/v3/projects/667c92f0d752417380f9754de3debc53` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:42.156616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] RBAC: Authorizing `identity:delete_project(project_id=667c92f0d752417380f9754de3debc53)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:42.158602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:42.198921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:42.213394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '667c92f0d752417380f9754de3debc53', 'request_id': 'req-729216b8-465f-4265-947e-715b1b28031d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.219610 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '667c92f0d752417380f9754de3debc53', 'request_id': 'req-729216b8-465f-4265-947e-715b1b28031d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.229444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '667c92f0d752417380f9754de3debc53', 'request_id': 'req-729216b8-465f-4265-947e-715b1b28031d'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.240978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] The token cache is being invalidate because project 667c92f0d752417380f9754de3debc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:42.241272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.241918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.243753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1103/2196] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:42 2022] DELETE /identity/v3/projects/667c92f0d752417380f9754de3debc53 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:42.247625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8af96-8fad-4263-bc5f-6af229b393c5 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:42.257275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8af96-8fad-4263-bc5f-6af229b393c5 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:42.316325 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:42.316967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:42.317252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:42.317521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] PATH_INFO: `/v3/users/a6983551fb1647c9a0df04c4905c0503` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:42.318778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6983551fb1647c9a0df04c4905c0503)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:42.320749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:42.366745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6983551fb1647c9a0df04c4905c0503'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.373606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6983551fb1647c9a0df04c4905c0503'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.380807 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6983551fb1647c9a0df04c4905c0503'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.381506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6983551fb1647c9a0df04c4905c0503'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.382184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a5f49cd9-931c-45e5-ab2a-af4028232ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6983551fb1647c9a0df04c4905c0503'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.399376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1094/2197] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:42 2022] DELETE /identity/v3/users/a6983551fb1647c9a0df04c4905c0503 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:42.467173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:42.468715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:42.482264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729216b8-465f-4265-947e-715b1b28031d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:42.539570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:42.540306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:42.540590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:42.540991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] PATH_INFO: `/v3/users/134161c5d1b8497bb31387cdc4d56420` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:42.542218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=134161c5d1b8497bb31387cdc4d56420)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:42.544310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:42.606753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '134161c5d1b8497bb31387cdc4d56420'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.620090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '134161c5d1b8497bb31387cdc4d56420'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.627851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '134161c5d1b8497bb31387cdc4d56420'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.628578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '134161c5d1b8497bb31387cdc4d56420'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.629215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '134161c5d1b8497bb31387cdc4d56420'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.645165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1104/2198] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:42 2022] DELETE /identity/v3/users/134161c5d1b8497bb31387cdc4d56420 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:42.651352 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360f94-feee-4d92-b598-1a5f9f516a7b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:42.651855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360f94-feee-4d92-b598-1a5f9f516a7b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:42.651957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78360f94-feee-4d92-b598-1a5f9f516a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:42.665002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:42.671181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-78360f94-feee-4d92-b598-1a5f9f516a7b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:42.673395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-78360f94-feee-4d92-b598-1a5f9f516a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:42.746403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1095/2199] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:42.757371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:42.759055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:42.784632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360f94-feee-4d92-b598-1a5f9f516a7b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:42.786346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-78360f94-feee-4d92-b598-1a5f9f516a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:42.817206 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78360f94-feee-4d92-b598-1a5f9f516a7b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:42.822578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:42.823410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:42.823812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:42.824102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] PATH_INFO: `/v3/projects/a6ec6efcc0d24583a97edf93ff40bb5a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:42.825303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ec6efcc0d24583a97edf93ff40bb5a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:42.827221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:42.840361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:42.858304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871d8eb-37df-4134-864b-0724ce9a27c8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:42.863069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf90ff-bb94-4790-bf79-2825d191f504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:42.863699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf90ff-bb94-4790-bf79-2825d191f504 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:42.864154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf90ff-bb94-4790-bf79-2825d191f504 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:42.864449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf90ff-bb94-4790-bf79-2825d191f504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:42.876295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf90ff-bb94-4790-bf79-2825d191f504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:42.878767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf90ff-bb94-4790-bf79-2825d191f504 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:42.884939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ec6efcc0d24583a97edf93ff40bb5a', 'request_id': 'req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.891199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1105/2200] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:42.893652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ec6efcc0d24583a97edf93ff40bb5a', 'request_id': 'req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.902065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ec6efcc0d24583a97edf93ff40bb5a', 'request_id': 'req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.918239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] The token cache is being invalidate because project a6ec6efcc0d24583a97edf93ff40bb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:42.918561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.919321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-13a4204d-fd55-48c2-9fc5-9ec5892bcc16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:42.920954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1096/2201] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:42 2022] DELETE /identity/v3/projects/a6ec6efcc0d24583a97edf93ff40bb5a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:42:42.925680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5b9d-12d1-4cb6-81c4-c975df9692a1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:42.925970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5b9d-12d1-4cb6-81c4-c975df9692a1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:42.926246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d5b9d-12d1-4cb6-81c4-c975df9692a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:42.947593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7e3d5b9d-12d1-4cb6-81c4-c975df9692a1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:42.949170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7e3d5b9d-12d1-4cb6-81c4-c975df9692a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:43.022114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1106/2202] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:43.030640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab64cef-3e52-4c36-b8cf-d18d266b9472 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.030907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab64cef-3e52-4c36-b8cf-d18d266b9472 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.031192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab64cef-3e52-4c36-b8cf-d18d266b9472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.055882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dab64cef-3e52-4c36-b8cf-d18d266b9472 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:43.057157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dab64cef-3e52-4c36-b8cf-d18d266b9472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:43.068409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1097/2203] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:43.070654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d5b9d-12d1-4cb6-81c4-c975df9692a1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.081108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d5b9d-12d1-4cb6-81c4-c975df9692a1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.086650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bd68e-1af2-45c0-87f5-3430a10ca35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.087322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bd68e-1af2-45c0-87f5-3430a10ca35c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.087602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bd68e-1af2-45c0-87f5-3430a10ca35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.088054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4bd68e-1af2-45c0-87f5-3430a10ca35c admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.088905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bd68e-1af2-45c0-87f5-3430a10ca35c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:43.089118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bd68e-1af2-45c0-87f5-3430a10ca35c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.090722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4bd68e-1af2-45c0-87f5-3430a10ca35c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.107498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1107/2204] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:43.112244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab64cef-3e52-4c36-b8cf-d18d266b9472 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.124477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab64cef-3e52-4c36-b8cf-d18d266b9472 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.131436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a383f1-eced-4bdb-85d1-7622a7fa3359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.132472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a383f1-eced-4bdb-85d1-7622a7fa3359 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.132920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a383f1-eced-4bdb-85d1-7622a7fa3359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.133356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a383f1-eced-4bdb-85d1-7622a7fa3359 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.134464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a383f1-eced-4bdb-85d1-7622a7fa3359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.136828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a383f1-eced-4bdb-85d1-7622a7fa3359 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.185136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1098/2205] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:43 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:43.189023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bd68e-1af2-45c0-87f5-3430a10ca35c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.201188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4bd68e-1af2-45c0-87f5-3430a10ca35c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.236629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a383f1-eced-4bdb-85d1-7622a7fa3359 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.238405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-35a383f1-eced-4bdb-85d1-7622a7fa3359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:43.275555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56155d9e-e93a-48a6-8cbf-dc413664d21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.276201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155d9e-e93a-48a6-8cbf-dc413664d21d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.276484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155d9e-e93a-48a6-8cbf-dc413664d21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.276758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56155d9e-e93a-48a6-8cbf-dc413664d21d admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.277451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56155d9e-e93a-48a6-8cbf-dc413664d21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.279565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56155d9e-e93a-48a6-8cbf-dc413664d21d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.304158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1108/2206] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:43 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:42:43.308250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56155d9e-e93a-48a6-8cbf-dc413664d21d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.315466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a383f1-eced-4bdb-85d1-7622a7fa3359 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.318479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56155d9e-e93a-48a6-8cbf-dc413664d21d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.320752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.321558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.321835 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.322107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] PATH_INFO: `/v3/projects/0e8eaba7492c4315b5f71046d74a5d42` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.323096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db018-fc38-4951-b6e5-af4abace45dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.323301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8eaba7492c4315b5f71046d74a5d42)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.323686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db018-fc38-4951-b6e5-af4abace45dd admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.323967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db018-fc38-4951-b6e5-af4abace45dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.324272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90db018-fc38-4951-b6e5-af4abace45dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.324967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db018-fc38-4951-b6e5-af4abace45dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.325288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.326587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90db018-fc38-4951-b6e5-af4abace45dd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.327775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:43.339518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1109/2207] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:42:43.343319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db018-fc38-4951-b6e5-af4abace45dd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.354312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90db018-fc38-4951-b6e5-af4abace45dd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.359114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf1db5-88d7-438a-98d6-62b6bc95c8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.359705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf1db5-88d7-438a-98d6-62b6bc95c8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.359983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf1db5-88d7-438a-98d6-62b6bc95c8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.360286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf1db5-88d7-438a-98d6-62b6bc95c8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.360969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf1db5-88d7-438a-98d6-62b6bc95c8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.362535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf1db5-88d7-438a-98d6-62b6bc95c8bc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.373683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1110/2208] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:42:43.377750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf1db5-88d7-438a-98d6-62b6bc95c8bc admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.379740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8eaba7492c4315b5f71046d74a5d42', 'request_id': 'req-e993d6f5-cf44-4817-bc53-71d0c51d0e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:43.388275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf1db5-88d7-438a-98d6-62b6bc95c8bc admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.388425 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8eaba7492c4315b5f71046d74a5d42', 'request_id': 'req-e993d6f5-cf44-4817-bc53-71d0c51d0e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:43.394654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8eaba7492c4315b5f71046d74a5d42', 'request_id': 'req-e993d6f5-cf44-4817-bc53-71d0c51d0e22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:43.405513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] The token cache is being invalidate because project 0e8eaba7492c4315b5f71046d74a5d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:43.405827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:43.406492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e993d6f5-cf44-4817-bc53-71d0c51d0e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:43.408073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1099/2209] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:43 2022] DELETE /identity/v3/projects/0e8eaba7492c4315b5f71046d74a5d42 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:42:43.413411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f200c2-2733-44ce-be28-4d6fb70f43d3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.413695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f200c2-2733-44ce-be28-4d6fb70f43d3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.413971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f200c2-2733-44ce-be28-4d6fb70f43d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.422090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:43.434157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-12f200c2-2733-44ce-be28-4d6fb70f43d3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:43.435558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-12f200c2-2733-44ce-be28-4d6fb70f43d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:43.447369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6a62f-a5cd-4fdc-a52e-1dd2a8a796b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.448043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a62f-a5cd-4fdc-a52e-1dd2a8a796b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.448472 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a62f-a5cd-4fdc-a52e-1dd2a8a796b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.449264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a62f-a5cd-4fdc-a52e-1dd2a8a796b6 admin admin] PATH_INFO: `/v3/projects/8b61310ac796403c83f65f12cb50d5eb/users/208870eafe4b4a53863a9e1049561824/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.463046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6a62f-a5cd-4fdc-a52e-1dd2a8a796b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b61310ac796403c83f65f12cb50d5eb, user_id=208870eafe4b4a53863a9e1049561824, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.465743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6a62f-a5cd-4fdc-a52e-1dd2a8a796b6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.481305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1111/2210] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:43 2022] PUT /identity/v3/projects/8b61310ac796403c83f65f12cb50d5eb/users/208870eafe4b4a53863a9e1049561824/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:42:43.492786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68300935-4142-415b-835e-6a2eea91427c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.493076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68300935-4142-415b-835e-6a2eea91427c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.493355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68300935-4142-415b-835e-6a2eea91427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.499568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1100/2211] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:43.507324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd9a9-02f3-431d-8cd7-25fafa0f1fb4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.507649 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd9a9-02f3-431d-8cd7-25fafa0f1fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.507935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cd9a9-02f3-431d-8cd7-25fafa0f1fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.520813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-68300935-4142-415b-835e-6a2eea91427c None None] MFA Rules not processed for user `208870eafe4b4a53863a9e1049561824`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:43.522061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-68300935-4142-415b-835e-6a2eea91427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:43.529464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-887cd9a9-02f3-431d-8cd7-25fafa0f1fb4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:43.530645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-887cd9a9-02f3-431d-8cd7-25fafa0f1fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:43.586279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1112/2212] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:43.589430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1101/2213] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:43.593675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68300935-4142-415b-835e-6a2eea91427c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.598522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd9a9-02f3-431d-8cd7-25fafa0f1fb4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.601442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-887cd9a9-02f3-431d-8cd7-25fafa0f1fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:43.605105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68300935-4142-415b-835e-6a2eea91427c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.609880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f59e-7bc4-44a6-ae8d-959a5e720024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.610492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f59e-7bc4-44a6-ae8d-959a5e720024 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.610773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f59e-7bc4-44a6-ae8d-959a5e720024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.611044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7f59e-7bc4-44a6-ae8d-959a5e720024 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.611746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f59e-7bc4-44a6-ae8d-959a5e720024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:43.612057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f59e-7bc4-44a6-ae8d-959a5e720024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.613735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7f59e-7bc4-44a6-ae8d-959a5e720024 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.625778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1113/2214] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:43.630352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f59e-7bc4-44a6-ae8d-959a5e720024 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.636151 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:43.640936 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7f59e-7bc4-44a6-ae8d-959a5e720024 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.646079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe2932-8972-4bf9-97c3-dae81b1168bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.646765 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe2932-8972-4bf9-97c3-dae81b1168bb admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.647106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe2932-8972-4bf9-97c3-dae81b1168bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.647535 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe2932-8972-4bf9-97c3-dae81b1168bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.648406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe2932-8972-4bf9-97c3-dae81b1168bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.650600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe2932-8972-4bf9-97c3-dae81b1168bb admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.659388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cd9a9-02f3-431d-8cd7-25fafa0f1fb4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.663661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d952-5372-47e7-aad0-0d7d1399a8c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.664330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d952-5372-47e7-aad0-0d7d1399a8c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.664608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d952-5372-47e7-aad0-0d7d1399a8c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.664879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249d952-5372-47e7-aad0-0d7d1399a8c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.674518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249d952-5372-47e7-aad0-0d7d1399a8c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.675943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249d952-5372-47e7-aad0-0d7d1399a8c0 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.680103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1114/2215] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:43 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:42:43.685299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe2932-8972-4bf9-97c3-dae81b1168bb admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.685871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1102/2216] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:43.752358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe2932-8972-4bf9-97c3-dae81b1168bb admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.757645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c4f62-a1ce-4b16-8642-6ac5eb4e49c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.758262 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c4f62-a1ce-4b16-8642-6ac5eb4e49c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.758710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c4f62-a1ce-4b16-8642-6ac5eb4e49c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.758986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c4f62-a1ce-4b16-8642-6ac5eb4e49c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.759651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c4f62-a1ce-4b16-8642-6ac5eb4e49c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.761609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c4f62-a1ce-4b16-8642-6ac5eb4e49c4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.782955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1115/2217] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:43 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:42:43.787109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d952-5372-47e7-aad0-0d7d1399a8c0 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.803087 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249d952-5372-47e7-aad0-0d7d1399a8c0 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.807822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3890fa-d8eb-44f7-a262-852da1365185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.808464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3890fa-d8eb-44f7-a262-852da1365185 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.808741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3890fa-d8eb-44f7-a262-852da1365185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.809010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3890fa-d8eb-44f7-a262-852da1365185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.809754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3890fa-d8eb-44f7-a262-852da1365185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.811378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3890fa-d8eb-44f7-a262-852da1365185 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.833371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1103/2218] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:42:43.837937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c4f62-a1ce-4b16-8642-6ac5eb4e49c4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.844820 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:43.851299 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c4f62-a1ce-4b16-8642-6ac5eb4e49c4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.862212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df572a4-c0a4-4c3b-8e95-380c3def24f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.863135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df572a4-c0a4-4c3b-8e95-380c3def24f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.863469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df572a4-c0a4-4c3b-8e95-380c3def24f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.863783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df572a4-c0a4-4c3b-8e95-380c3def24f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.865381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df572a4-c0a4-4c3b-8e95-380c3def24f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.867236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df572a4-c0a4-4c3b-8e95-380c3def24f3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.882327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1116/2219] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:43.883798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3890fa-d8eb-44f7-a262-852da1365185 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:43.894237 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3890fa-d8eb-44f7-a262-852da1365185 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:43.900111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c643292-f3a5-4d67-b246-22a8bf80fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:43.900604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c643292-f3a5-4d67-b246-22a8bf80fcad admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.901052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c643292-f3a5-4d67-b246-22a8bf80fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.901395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c643292-f3a5-4d67-b246-22a8bf80fcad admin admin] PATH_INFO: `/v3/projects/6ad9c5cd07704e09838eea45f9c73824/users/54af9461dbb642caa0571b537d1fb577/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:43.917637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c643292-f3a5-4d67-b246-22a8bf80fcad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad9c5cd07704e09838eea45f9c73824, user_id=54af9461dbb642caa0571b537d1fb577, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:43.921548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c643292-f3a5-4d67-b246-22a8bf80fcad admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:43.939326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1104/2220] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:43 2022] PUT /identity/v3/projects/6ad9c5cd07704e09838eea45f9c73824/users/54af9461dbb642caa0571b537d1fb577/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:43.957696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29565d12-d41c-4f44-b75f-8aa361d05cfb None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:43.958108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29565d12-d41c-4f44-b75f-8aa361d05cfb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:43.958578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29565d12-d41c-4f44-b75f-8aa361d05cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:44.010071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-29565d12-d41c-4f44-b75f-8aa361d05cfb None None] MFA Rules not processed for user `54af9461dbb642caa0571b537d1fb577`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:44.011916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-29565d12-d41c-4f44-b75f-8aa361d05cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:44.081596 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1117/2221] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:42:43 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:44.093061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c643292-f3a5-4d67-b246-22a8bf80fcad admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:44.147558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c643292-f3a5-4d67-b246-22a8bf80fcad admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:44.151415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c54e37-d354-4e87-9bb7-034aa3ad465a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:44.152022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c54e37-d354-4e87-9bb7-034aa3ad465a service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:44.152412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c54e37-d354-4e87-9bb7-034aa3ad465a service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:44.152687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c54e37-d354-4e87-9bb7-034aa3ad465a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:44.160938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c54e37-d354-4e87-9bb7-034aa3ad465a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:44.162845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c54e37-d354-4e87-9bb7-034aa3ad465a service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:44.171578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1105/2222] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:44 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:54.078661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=35 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:54.167531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:59.945433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29565d12-d41c-4f44-b75f-8aa361d05cfb None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:59.946885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-29565d12-d41c-4f44-b75f-8aa361d05cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:00.011515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29565d12-d41c-4f44-b75f-8aa361d05cfb None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:00.016366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:00.017108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:00.017461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:00.017803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] PATH_INFO: `/v3/users/208870eafe4b4a53863a9e1049561824` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:00.019024 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] RBAC: Authorizing `identity:delete_user(user_id=208870eafe4b4a53863a9e1049561824)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:00.021734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:00.066405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208870eafe4b4a53863a9e1049561824'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.078851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208870eafe4b4a53863a9e1049561824'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.086126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208870eafe4b4a53863a9e1049561824'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.086807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208870eafe4b4a53863a9e1049561824'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.087415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208870eafe4b4a53863a9e1049561824'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.100547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1118/2223] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:59 2022] DELETE /identity/v3/users/208870eafe4b4a53863a9e1049561824 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:00.105001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151b14-8a0a-45a4-9015-80e4c1e96b38 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:00.105447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151b14-8a0a-45a4-9015-80e4c1e96b38 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:00.105578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2151b14-8a0a-45a4-9015-80e4c1e96b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:00.123710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d2151b14-8a0a-45a4-9015-80e4c1e96b38 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:00.124926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d2151b14-8a0a-45a4-9015-80e4c1e96b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:00.182108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1106/2224] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:00.192230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:00.194150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:00.252662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c832d0-2181-490c-85da-12b0001414da admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:00.256870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83378b77-d82c-4d28-a197-7993f609e364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:00.257480 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83378b77-d82c-4d28-a197-7993f609e364 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:00.257758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83378b77-d82c-4d28-a197-7993f609e364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:00.258031 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83378b77-d82c-4d28-a197-7993f609e364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:00.267230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83378b77-d82c-4d28-a197-7993f609e364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:00.268706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83378b77-d82c-4d28-a197-7993f609e364 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:00.279319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1119/2225] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:00.608671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2151b14-8a0a-45a4-9015-80e4c1e96b38 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:00.610568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d2151b14-8a0a-45a4-9015-80e4c1e96b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:00.625297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2151b14-8a0a-45a4-9015-80e4c1e96b38 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:00.632249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:00.633154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:00.633699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:00.634070 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] PATH_INFO: `/v3/projects/8b61310ac796403c83f65f12cb50d5eb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:00.635210 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b61310ac796403c83f65f12cb50d5eb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:00.637311 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:00.717937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b61310ac796403c83f65f12cb50d5eb', 'request_id': 'req-38a762d7-9f39-4049-bdcc-f5b928cb1e83'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.730064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b61310ac796403c83f65f12cb50d5eb', 'request_id': 'req-38a762d7-9f39-4049-bdcc-f5b928cb1e83'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.738158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b61310ac796403c83f65f12cb50d5eb', 'request_id': 'req-38a762d7-9f39-4049-bdcc-f5b928cb1e83'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.751361 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] The token cache is being invalidate because project 8b61310ac796403c83f65f12cb50d5eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:00.751721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.752506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-38a762d7-9f39-4049-bdcc-f5b928cb1e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:00.754952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1107/2226] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:00 2022] DELETE /identity/v3/projects/8b61310ac796403c83f65f12cb50d5eb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:00.759606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cbba4-3814-45e0-be27-528b448d5f0e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:00.759883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cbba4-3814-45e0-be27-528b448d5f0e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:00.760253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cbba4-3814-45e0-be27-528b448d5f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:00.779951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f24cbba4-3814-45e0-be27-528b448d5f0e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:00.781198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f24cbba4-3814-45e0-be27-528b448d5f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:00.802557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:00.847651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1120/2227] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:00.855860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453181a6-a9e6-47c5-a876-80dadb4ad4a0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:00.856191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453181a6-a9e6-47c5-a876-80dadb4ad4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:00.856477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453181a6-a9e6-47c5-a876-80dadb4ad4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:00.877409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-453181a6-a9e6-47c5-a876-80dadb4ad4a0 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:00.878623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-453181a6-a9e6-47c5-a876-80dadb4ad4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:00.886754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1108/2228] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:00.891421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cbba4-3814-45e0-be27-528b448d5f0e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:00.901624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cbba4-3814-45e0-be27-528b448d5f0e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:00.906223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf67f7-80f6-4f78-8f5c-aaa6b2a910ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:00.906868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf67f7-80f6-4f78-8f5c-aaa6b2a910ee admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:00.907153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf67f7-80f6-4f78-8f5c-aaa6b2a910ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:00.907430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf67f7-80f6-4f78-8f5c-aaa6b2a910ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:00.908128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf67f7-80f6-4f78-8f5c-aaa6b2a910ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:00.908470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf67f7-80f6-4f78-8f5c-aaa6b2a910ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:00.910062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf67f7-80f6-4f78-8f5c-aaa6b2a910ee admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:00.921924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1121/2229] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:43:00.926269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453181a6-a9e6-47c5-a876-80dadb4ad4a0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:00.935943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453181a6-a9e6-47c5-a876-80dadb4ad4a0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:00.940491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594514c-9842-45bd-9281-ea6d1e65add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:00.941085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594514c-9842-45bd-9281-ea6d1e65add2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:00.941367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594514c-9842-45bd-9281-ea6d1e65add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:00.941634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594514c-9842-45bd-9281-ea6d1e65add2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:00.942292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594514c-9842-45bd-9281-ea6d1e65add2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:00.944162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8594514c-9842-45bd-9281-ea6d1e65add2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:00.970971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1109/2230] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:00 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:00.975716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf67f7-80f6-4f78-8f5c-aaa6b2a910ee admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:00.986058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf67f7-80f6-4f78-8f5c-aaa6b2a910ee admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:01.044126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432231a-3d9a-47be-906f-70b6563acd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:01.044795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432231a-3d9a-47be-906f-70b6563acd87 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.045046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432231a-3d9a-47be-906f-70b6563acd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.045323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3432231a-3d9a-47be-906f-70b6563acd87 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.045991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432231a-3d9a-47be-906f-70b6563acd87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:01.047907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3432231a-3d9a-47be-906f-70b6563acd87 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:01.068292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1122/2231] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:00 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:01.072319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594514c-9842-45bd-9281-ea6d1e65add2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:01.082590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594514c-9842-45bd-9281-ea6d1e65add2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:01.087899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403d9cc-518a-493a-942b-1f14037e3a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:01.088707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403d9cc-518a-493a-942b-1f14037e3a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.089012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403d9cc-518a-493a-942b-1f14037e3a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.089375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403d9cc-518a-493a-942b-1f14037e3a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.090106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403d9cc-518a-493a-942b-1f14037e3a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:01.092029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403d9cc-518a-493a-942b-1f14037e3a68 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:01.102765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1110/2232] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:01.106987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432231a-3d9a-47be-906f-70b6563acd87 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:01.116802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3432231a-3d9a-47be-906f-70b6563acd87 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:01.121437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85897993-238e-4fc7-b55f-85886c1fdc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:01.122041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85897993-238e-4fc7-b55f-85886c1fdc62 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.122320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85897993-238e-4fc7-b55f-85886c1fdc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.122598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85897993-238e-4fc7-b55f-85886c1fdc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.123318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85897993-238e-4fc7-b55f-85886c1fdc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:01.124927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85897993-238e-4fc7-b55f-85886c1fdc62 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:01.135920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1123/2233] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:01.140336 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403d9cc-518a-493a-942b-1f14037e3a68 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:01.151510 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403d9cc-518a-493a-942b-1f14037e3a68 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:01.156145 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21873b2-127d-4aa4-a788-65084cceb5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:01.156814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21873b2-127d-4aa4-a788-65084cceb5fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.157106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21873b2-127d-4aa4-a788-65084cceb5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.157383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21873b2-127d-4aa4-a788-65084cceb5fe admin admin] PATH_INFO: `/v3/projects/30e364f71309487284d954213a52c8a4/users/a8a2cea0a68d4a0ab1764f8643803171/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.175359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21873b2-127d-4aa4-a788-65084cceb5fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e364f71309487284d954213a52c8a4, user_id=a8a2cea0a68d4a0ab1764f8643803171, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:01.178318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21873b2-127d-4aa4-a788-65084cceb5fe admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:01.192700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1111/2234] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:01 2022] PUT /identity/v3/projects/30e364f71309487284d954213a52c8a4/users/a8a2cea0a68d4a0ab1764f8643803171/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:01.202886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffeea6-2460-4f54-813f-831054ec5042 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.203175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffeea6-2460-4f54-813f-831054ec5042 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.203448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffeea6-2460-4f54-813f-831054ec5042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.231267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-daffeea6-2460-4f54-813f-831054ec5042 None None] MFA Rules not processed for user `a8a2cea0a68d4a0ab1764f8643803171`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:01.232545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-daffeea6-2460-4f54-813f-831054ec5042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:01.295163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1124/2235] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:01.306523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21873b2-127d-4aa4-a788-65084cceb5fe admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:01.308214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d21873b2-127d-4aa4-a788-65084cceb5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:01.329854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:01.366344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21873b2-127d-4aa4-a788-65084cceb5fe admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:01.369985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d601e73-e75e-4a7a-98a8-e73c110f30a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:01.370593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601e73-e75e-4a7a-98a8-e73c110f30a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.370874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601e73-e75e-4a7a-98a8-e73c110f30a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.371148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d601e73-e75e-4a7a-98a8-e73c110f30a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.379442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d601e73-e75e-4a7a-98a8-e73c110f30a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:01.381397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d601e73-e75e-4a7a-98a8-e73c110f30a8 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:01.390116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1112/2236] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:01.416566 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffeea6-2460-4f54-813f-831054ec5042 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:01.436436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:01.481055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffeea6-2460-4f54-813f-831054ec5042 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:01.485637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:01.486285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.486567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.486843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] PATH_INFO: `/v3/users/a8a2cea0a68d4a0ab1764f8643803171` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.488054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a2cea0a68d4a0ab1764f8643803171)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:01.490066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:01.541185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a2cea0a68d4a0ab1764f8643803171'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.554487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a2cea0a68d4a0ab1764f8643803171'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.562122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a2cea0a68d4a0ab1764f8643803171'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.562966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a2cea0a68d4a0ab1764f8643803171'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.563938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a2cea0a68d4a0ab1764f8643803171'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.582041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1125/2237] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:01 2022] DELETE /identity/v3/users/a8a2cea0a68d4a0ab1764f8643803171 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:01.584915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc28c1-67c3-48b3-bb58-4b736b4e89e3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.585309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc28c1-67c3-48b3-bb58-4b736b4e89e3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.585712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc28c1-67c3-48b3-bb58-4b736b4e89e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.614327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-05bc28c1-67c3-48b3-bb58-4b736b4e89e3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:01.615827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-05bc28c1-67c3-48b3-bb58-4b736b4e89e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:01.674064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:01.675533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:01.682266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1113/2238] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:01.689967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582b645-a219-4387-ad68-722624322bb6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:01.691755 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc28c1-67c3-48b3-bb58-4b736b4e89e3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:01.693771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-05bc28c1-67c3-48b3-bb58-4b736b4e89e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:01.695533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:01.696222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.696508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.696783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] PATH_INFO: `/v3/users/54af9461dbb642caa0571b537d1fb577` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.698140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54af9461dbb642caa0571b537d1fb577)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:01.700382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:01.756632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc28c1-67c3-48b3-bb58-4b736b4e89e3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:01.758358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54af9461dbb642caa0571b537d1fb577'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.760537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df87f8-cbc0-4328-a37c-190330b7e623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:01.761375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df87f8-cbc0-4328-a37c-190330b7e623 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.761749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df87f8-cbc0-4328-a37c-190330b7e623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.762165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df87f8-cbc0-4328-a37c-190330b7e623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.773601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54af9461dbb642caa0571b537d1fb577'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.775565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df87f8-cbc0-4328-a37c-190330b7e623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:01.777109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df87f8-cbc0-4328-a37c-190330b7e623 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:01.784600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54af9461dbb642caa0571b537d1fb577'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.785354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54af9461dbb642caa0571b537d1fb577'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.786000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54af9461dbb642caa0571b537d1fb577'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:01.787945 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1114/2239] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:01.813979 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1126/2240] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:01 2022] DELETE /identity/v3/users/54af9461dbb642caa0571b537d1fb577 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:01.815132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7589c6-90f6-4ffb-a1e8-72ef59f8613e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.815419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7589c6-90f6-4ffb-a1e8-72ef59f8613e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.815688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7589c6-90f6-4ffb-a1e8-72ef59f8613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.839850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ed7589c6-90f6-4ffb-a1e8-72ef59f8613e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:01.841132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ed7589c6-90f6-4ffb-a1e8-72ef59f8613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:01.902671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1115/2241] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:01.912926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:01.914336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:01.925081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:01.974955 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bf0f54-1e37-4469-949c-719dcd06a223 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:01.978640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264850a-a409-4a53-8828-59f195bdd482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:01.979302 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264850a-a409-4a53-8828-59f195bdd482 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:01.979538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264850a-a409-4a53-8828-59f195bdd482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:01.979809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264850a-a409-4a53-8828-59f195bdd482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:01.989611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264850a-a409-4a53-8828-59f195bdd482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:01.990992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264850a-a409-4a53-8828-59f195bdd482 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.000903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1127/2242] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:43:02.088985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7589c6-90f6-4ffb-a1e8-72ef59f8613e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.091185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ed7589c6-90f6-4ffb-a1e8-72ef59f8613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:02.109445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7589c6-90f6-4ffb-a1e8-72ef59f8613e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.120305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.121074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.121420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.121706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] PATH_INFO: `/v3/projects/30e364f71309487284d954213a52c8a4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.123220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e364f71309487284d954213a52c8a4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.125066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.126854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:02.187865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e364f71309487284d954213a52c8a4', 'request_id': 'req-46b6965d-7df1-4da2-b153-b24df33c2cdb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.196467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e364f71309487284d954213a52c8a4', 'request_id': 'req-46b6965d-7df1-4da2-b153-b24df33c2cdb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.202920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e364f71309487284d954213a52c8a4', 'request_id': 'req-46b6965d-7df1-4da2-b153-b24df33c2cdb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.214608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] The token cache is being invalidate because project 30e364f71309487284d954213a52c8a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:02.214902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.215547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.217110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1116/2243] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:02 2022] DELETE /identity/v3/projects/30e364f71309487284d954213a52c8a4 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:02.222071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86834cb6-8962-40a0-873e-49167a0ec4f1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.222388 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86834cb6-8962-40a0-873e-49167a0ec4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.222667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86834cb6-8962-40a0-873e-49167a0ec4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.242019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-86834cb6-8962-40a0-873e-49167a0ec4f1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:02.243437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-86834cb6-8962-40a0-873e-49167a0ec4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:02.293338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.294916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:02.319177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1128/2244] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:02.371612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6965d-7df1-4da2-b153-b24df33c2cdb admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.376458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.377255 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.377540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.377813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] PATH_INFO: `/v3/projects/6ad9c5cd07704e09838eea45f9c73824` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.379043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad9c5cd07704e09838eea45f9c73824)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.381525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.385036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c55d36-b83c-41dc-8023-6c218430fbbc None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.385327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c55d36-b83c-41dc-8023-6c218430fbbc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.385606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c55d36-b83c-41dc-8023-6c218430fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.406593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-06c55d36-b83c-41dc-8023-6c218430fbbc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:02.408699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-06c55d36-b83c-41dc-8023-6c218430fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:02.419962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1129/2245] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:02.424047 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c55d36-b83c-41dc-8023-6c218430fbbc None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.429507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad9c5cd07704e09838eea45f9c73824', 'request_id': 'req-bddfab56-876c-464e-8080-abe776371667'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.433306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c55d36-b83c-41dc-8023-6c218430fbbc None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.437139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad9c5cd07704e09838eea45f9c73824', 'request_id': 'req-bddfab56-876c-464e-8080-abe776371667'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.444436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad9c5cd07704e09838eea45f9c73824', 'request_id': 'req-bddfab56-876c-464e-8080-abe776371667'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.454791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] The token cache is being invalidate because project 6ad9c5cd07704e09838eea45f9c73824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:02.455082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.455732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bddfab56-876c-464e-8080-abe776371667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:02.457295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1117/2246] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:02 2022] DELETE /identity/v3/projects/6ad9c5cd07704e09838eea45f9c73824 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:02.462422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e7834-16ae-48e7-b392-411ed7305a37 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.462706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e7834-16ae-48e7-b392-411ed7305a37 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.462983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e7834-16ae-48e7-b392-411ed7305a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.485222 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-354e7834-16ae-48e7-b392-411ed7305a37 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:02.486698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-354e7834-16ae-48e7-b392-411ed7305a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:02.497096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.497717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.497996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.498269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.498965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:02.499265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.500899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.501181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:02.516807 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1130/2247] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:43:02.518066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.519735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:02.532309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb20972-596f-4676-ab16-f7b0b81e1da4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.538976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108becc9-30c3-4fc8-957f-eb230bfafb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.539589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108becc9-30c3-4fc8-957f-eb230bfafb29 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.539873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108becc9-30c3-4fc8-957f-eb230bfafb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.540175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108becc9-30c3-4fc8-957f-eb230bfafb29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.540849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108becc9-30c3-4fc8-957f-eb230bfafb29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.542750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108becc9-30c3-4fc8-957f-eb230bfafb29 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.554285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1118/2248] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:02.561915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a2cba-e193-449f-9087-e71cfe552832 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.562377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a2cba-e193-449f-9087-e71cfe552832 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.562705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a2cba-e193-449f-9087-e71cfe552832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.575153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1131/2249] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:02 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:02.579132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108becc9-30c3-4fc8-957f-eb230bfafb29 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.582636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e21a2cba-e193-449f-9087-e71cfe552832 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:02.583869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e21a2cba-e193-449f-9087-e71cfe552832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:02.598401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:02.646082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108becc9-30c3-4fc8-957f-eb230bfafb29 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.652125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4affd-4f0d-493d-b81b-f33f03637595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.652862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4affd-4f0d-493d-b81b-f33f03637595 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.653209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4affd-4f0d-493d-b81b-f33f03637595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.653548 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4affd-4f0d-493d-b81b-f33f03637595 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.654281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4affd-4f0d-493d-b81b-f33f03637595 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.656318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4affd-4f0d-493d-b81b-f33f03637595 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.659278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1119/2250] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:02.665157 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a2cba-e193-449f-9087-e71cfe552832 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.675669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a2cba-e193-449f-9087-e71cfe552832 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.681013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1132/2251] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:02 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:02.684961 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4affd-4f0d-493d-b81b-f33f03637595 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.685131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c1740-0038-4c73-bc6e-1e5edd84cfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.685763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c1740-0038-4c73-bc6e-1e5edd84cfff admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.686045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c1740-0038-4c73-bc6e-1e5edd84cfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.686313 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c1740-0038-4c73-bc6e-1e5edd84cfff admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.687013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c1740-0038-4c73-bc6e-1e5edd84cfff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:02.687322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c1740-0038-4c73-bc6e-1e5edd84cfff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.688939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c1740-0038-4c73-bc6e-1e5edd84cfff admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.696463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4affd-4f0d-493d-b81b-f33f03637595 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.702198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd3379-c01b-4c8f-90d5-d214610a2b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.702932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd3379-c01b-4c8f-90d5-d214610a2b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.703425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd3379-c01b-4c8f-90d5-d214610a2b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.703803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd3379-c01b-4c8f-90d5-d214610a2b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.704656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd3379-c01b-4c8f-90d5-d214610a2b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.708375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1120/2252] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:43:02.708485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd3379-c01b-4c8f-90d5-d214610a2b24 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.709004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c1740-0038-4c73-bc6e-1e5edd84cfff admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.717043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1133/2253] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:43:02.721363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd3379-c01b-4c8f-90d5-d214610a2b24 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.721951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c1740-0038-4c73-bc6e-1e5edd84cfff admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.726998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4575-cabb-44ed-8a35-05a7d6b9b74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.727505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4575-cabb-44ed-8a35-05a7d6b9b74a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.727784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4575-cabb-44ed-8a35-05a7d6b9b74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.728054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4575-cabb-44ed-8a35-05a7d6b9b74a admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.729027 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4575-cabb-44ed-8a35-05a7d6b9b74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.731746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4575-cabb-44ed-8a35-05a7d6b9b74a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.734364 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd3379-c01b-4c8f-90d5-d214610a2b24 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.739041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac54e6c-baf3-4bbf-bdc3-79edee757197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.740399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac54e6c-baf3-4bbf-bdc3-79edee757197 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.740750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac54e6c-baf3-4bbf-bdc3-79edee757197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.741099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac54e6c-baf3-4bbf-bdc3-79edee757197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.741869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac54e6c-baf3-4bbf-bdc3-79edee757197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.743543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac54e6c-baf3-4bbf-bdc3-79edee757197 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.754367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1134/2254] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:43:02.759397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac54e6c-baf3-4bbf-bdc3-79edee757197 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.770583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac54e6c-baf3-4bbf-bdc3-79edee757197 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.779318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1121/2255] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:02 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:02.779424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f19da-7733-46ab-b095-14608ae16a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.779424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f19da-7733-46ab-b095-14608ae16a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.779424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f19da-7733-46ab-b095-14608ae16a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.779424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f19da-7733-46ab-b095-14608ae16a6e admin admin] PATH_INFO: `/v3/projects/e94861fe088e4dc091bfa76d5a100fd5/users/228eefac4dab4b5d937bf66ea6e0eb8e/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.781388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4575-cabb-44ed-8a35-05a7d6b9b74a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.792790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f19da-7733-46ab-b095-14608ae16a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94861fe088e4dc091bfa76d5a100fd5, user_id=228eefac4dab4b5d937bf66ea6e0eb8e, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.795420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f19da-7733-46ab-b095-14608ae16a6e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.815225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1135/2256] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:02 2022] PUT /identity/v3/projects/e94861fe088e4dc091bfa76d5a100fd5/users/228eefac4dab4b5d937bf66ea6e0eb8e/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:02.820643 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa925ac-aabc-4cef-80c5-bd82e4a9a1ae None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.820937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa925ac-aabc-4cef-80c5-bd82e4a9a1ae None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.821293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa925ac-aabc-4cef-80c5-bd82e4a9a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.843523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5aa925ac-aabc-4cef-80c5-bd82e4a9a1ae None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:02.844965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5aa925ac-aabc-4cef-80c5-bd82e4a9a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:02.847925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4575-cabb-44ed-8a35-05a7d6b9b74a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.882502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:02.906476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1136/2257] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:02.921433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b687d3a-0c2e-4f9f-9c16-e4f716b6a7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.922064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b687d3a-0c2e-4f9f-9c16-e4f716b6a7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.922469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b687d3a-0c2e-4f9f-9c16-e4f716b6a7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.922741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b687d3a-0c2e-4f9f-9c16-e4f716b6a7dc admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.923415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b687d3a-0c2e-4f9f-9c16-e4f716b6a7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.924264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa925ac-aabc-4cef-80c5-bd82e4a9a1ae None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.925362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b687d3a-0c2e-4f9f-9c16-e4f716b6a7dc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.926135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5aa925ac-aabc-4cef-80c5-bd82e4a9a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:02.947529 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1122/2258] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:02 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:02.951558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b687d3a-0c2e-4f9f-9c16-e4f716b6a7dc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.961177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b687d3a-0c2e-4f9f-9c16-e4f716b6a7dc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.965776 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f563cf5-a4ef-41ac-9bca-de50251809f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.966371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f563cf5-a4ef-41ac-9bca-de50251809f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.966651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f563cf5-a4ef-41ac-9bca-de50251809f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.966927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f563cf5-a4ef-41ac-9bca-de50251809f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.967609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f563cf5-a4ef-41ac-9bca-de50251809f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:02.969308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f563cf5-a4ef-41ac-9bca-de50251809f0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:02.982487 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1123/2259] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:43:02.983468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f563cf5-a4ef-41ac-9bca-de50251809f0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:02.986348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa925ac-aabc-4cef-80c5-bd82e4a9a1ae None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.990761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181d1fe-58ee-4bb7-92b7-161e9a82d804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.991378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181d1fe-58ee-4bb7-92b7-161e9a82d804 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.991650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181d1fe-58ee-4bb7-92b7-161e9a82d804 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.991915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181d1fe-58ee-4bb7-92b7-161e9a82d804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:02.993410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f563cf5-a4ef-41ac-9bca-de50251809f0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:02.998279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826ecb8-3025-4d31-9588-081ad6d7bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:02.998876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ecb8-3025-4d31-9588-081ad6d7bedb admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:02.999159 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ecb8-3025-4d31-9588-081ad6d7bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:02.999437 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826ecb8-3025-4d31-9588-081ad6d7bedb admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:03.000123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ecb8-3025-4d31-9588-081ad6d7bedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:03.001426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181d1fe-58ee-4bb7-92b7-161e9a82d804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:03.001749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826ecb8-3025-4d31-9588-081ad6d7bedb admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:03.002841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181d1fe-58ee-4bb7-92b7-161e9a82d804 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:03.012315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1137/2260] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:43:03.013048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1124/2261] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:03.016989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181d1fe-58ee-4bb7-92b7-161e9a82d804 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:03.023138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:03.027435 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181d1fe-58ee-4bb7-92b7-161e9a82d804 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:03.033460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5cbb6-6588-48b9-b7fb-93481dd9fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:03.034396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5cbb6-6588-48b9-b7fb-93481dd9fd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:03.034878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5cbb6-6588-48b9-b7fb-93481dd9fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:03.035199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5cbb6-6588-48b9-b7fb-93481dd9fd91 admin admin] PATH_INFO: `/v3/projects/0bed6dd5430c4c9983aff2e2f261f5a4/users/5377fd0bccf748dda1d0192080253dcf/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:03.052454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5cbb6-6588-48b9-b7fb-93481dd9fd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bed6dd5430c4c9983aff2e2f261f5a4, user_id=5377fd0bccf748dda1d0192080253dcf, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:03.055138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5cbb6-6588-48b9-b7fb-93481dd9fd91 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:03.068127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1138/2262] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:03 2022] PUT /identity/v3/projects/0bed6dd5430c4c9983aff2e2f261f5a4/users/5377fd0bccf748dda1d0192080253dcf/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:03.073243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1357ea-4980-40ec-8ae8-026099561b2b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:03.073843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1357ea-4980-40ec-8ae8-026099561b2b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:03.074168 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1357ea-4980-40ec-8ae8-026099561b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:03.093992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4f1357ea-4980-40ec-8ae8-026099561b2b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:03.095280 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4f1357ea-4980-40ec-8ae8-026099561b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:03.158278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1125/2263] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:03.168866 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5cbb6-6588-48b9-b7fb-93481dd9fd91 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:03.171356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ded5cbb6-6588-48b9-b7fb-93481dd9fd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:03.232162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5cbb6-6588-48b9-b7fb-93481dd9fd91 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:03.235794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ea9b-b814-4697-8bff-d7c747955572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:03.236444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ea9b-b814-4697-8bff-d7c747955572 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:03.236724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ea9b-b814-4697-8bff-d7c747955572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:03.236998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ea9b-b814-4697-8bff-d7c747955572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:03.247285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235ea9b-b814-4697-8bff-d7c747955572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:03.248821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235ea9b-b814-4697-8bff-d7c747955572 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:03.258603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1139/2264] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:43:09.212306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63638b27-3240-4bf5-9dc3-fd4d0819a99e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:09.212306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63638b27-3240-4bf5-9dc3-fd4d0819a99e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:09.212306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63638b27-3240-4bf5-9dc3-fd4d0819a99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:09.299871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-63638b27-3240-4bf5-9dc3-fd4d0819a99e None None] MFA Rules not processed for user `228eefac4dab4b5d937bf66ea6e0eb8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:09.302220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-63638b27-3240-4bf5-9dc3-fd4d0819a99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:09.414673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1126/2265] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:09.419099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ea9b-b814-4697-8bff-d7c747955572 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:09.433645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235ea9b-b814-4697-8bff-d7c747955572 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:09.456933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677332a-92d1-4599-8b06-be8c5bdf1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:09.457754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677332a-92d1-4599-8b06-be8c5bdf1218 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:09.458039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677332a-92d1-4599-8b06-be8c5bdf1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:09.458311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677332a-92d1-4599-8b06-be8c5bdf1218 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:09.459145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677332a-92d1-4599-8b06-be8c5bdf1218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:09.461294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677332a-92d1-4599-8b06-be8c5bdf1218 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:09.505569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b863-123e-487e-a1cd-c60463059168 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:09.505857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b863-123e-487e-a1cd-c60463059168 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:09.506130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a6b863-123e-487e-a1cd-c60463059168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:09.542924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1140/2266] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:09 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:09.549183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677332a-92d1-4599-8b06-be8c5bdf1218 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:09.559926 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-92a6b863-123e-487e-a1cd-c60463059168 None None] MFA Rules not processed for user `5377fd0bccf748dda1d0192080253dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:09.561460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-92a6b863-123e-487e-a1cd-c60463059168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:09.585431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:09.653240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1127/2267] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:09.654170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6b863-123e-487e-a1cd-c60463059168 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:09.700656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677332a-92d1-4599-8b06-be8c5bdf1218 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:09.706531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295b16e-4a0b-42bc-a6ae-58f851ffcd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:09.707952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295b16e-4a0b-42bc-a6ae-58f851ffcd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:09.708303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295b16e-4a0b-42bc-a6ae-58f851ffcd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:09.708579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295b16e-4a0b-42bc-a6ae-58f851ffcd4d admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:09.709448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295b16e-4a0b-42bc-a6ae-58f851ffcd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:09.718518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295b16e-4a0b-42bc-a6ae-58f851ffcd4d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:09.771525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a6b863-123e-487e-a1cd-c60463059168 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:09.787690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1141/2268] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:09 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:09.788613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397b77a-27c2-42a7-8793-01e07808aa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:09.788769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295b16e-4a0b-42bc-a6ae-58f851ffcd4d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:09.790769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397b77a-27c2-42a7-8793-01e07808aa32 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:09.791240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397b77a-27c2-42a7-8793-01e07808aa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:09.791661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397b77a-27c2-42a7-8793-01e07808aa32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:09.793779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397b77a-27c2-42a7-8793-01e07808aa32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:09.796274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397b77a-27c2-42a7-8793-01e07808aa32 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:09.814756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295b16e-4a0b-42bc-a6ae-58f851ffcd4d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:09.830279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0ed8-afc9-43f4-b099-9a7f8d974053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:09.831175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0ed8-afc9-43f4-b099-9a7f8d974053 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:09.839073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0ed8-afc9-43f4-b099-9a7f8d974053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:09.840843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf0ed8-afc9-43f4-b099-9a7f8d974053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:09.842065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0ed8-afc9-43f4-b099-9a7f8d974053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:09.844646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf0ed8-afc9-43f4-b099-9a7f8d974053 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:09.858389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1128/2269] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:09 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:09.862398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397b77a-27c2-42a7-8793-01e07808aa32 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:09.869325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1142/2270] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:09.874524 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0ed8-afc9-43f4-b099-9a7f8d974053 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:09.889434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf0ed8-afc9-43f4-b099-9a7f8d974053 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:09.972700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:09.999718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397b77a-27c2-42a7-8793-01e07808aa32 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:10.004780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b57ba-6c57-4ce4-8165-dd38357a84a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:10.004965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2299c11-d533-4006-9702-596fad529c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:10.005410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b57ba-6c57-4ce4-8165-dd38357a84a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:10.005693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b57ba-6c57-4ce4-8165-dd38357a84a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:10.005914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2299c11-d533-4006-9702-596fad529c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:10.006038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80b57ba-6c57-4ce4-8165-dd38357a84a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:10.006317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2299c11-d533-4006-9702-596fad529c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:10.006664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2299c11-d533-4006-9702-596fad529c19 admin admin] PATH_INFO: `/v3/projects/e251ef63a07840498f6fbde1b6a5fa27/users/27666d500143473ca34b3b0578d443a8/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:10.006972 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b57ba-6c57-4ce4-8165-dd38357a84a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:10.008968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80b57ba-6c57-4ce4-8165-dd38357a84a7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:10.031233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2299c11-d533-4006-9702-596fad529c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e251ef63a07840498f6fbde1b6a5fa27, user_id=27666d500143473ca34b3b0578d443a8, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:10.035044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2299c11-d533-4006-9702-596fad529c19 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:10.046970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1129/2271] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:09 2022] POST /identity/v3/users => generated 296 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:10.051056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b57ba-6c57-4ce4-8165-dd38357a84a7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:10.057539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1143/2272] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:09 2022] PUT /identity/v3/projects/e251ef63a07840498f6fbde1b6a5fa27/users/27666d500143473ca34b3b0578d443a8/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:10.063204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2299c11-d533-4006-9702-596fad529c19 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:10.066831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80b57ba-6c57-4ce4-8165-dd38357a84a7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:10.127314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:10.168800 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094c7e-58a1-4d50-a73f-82c10a06a741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:10.170574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2299c11-d533-4006-9702-596fad529c19 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:10.171383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094c7e-58a1-4d50-a73f-82c10a06a741 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:10.171849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094c7e-58a1-4d50-a73f-82c10a06a741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:10.172349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e094c7e-58a1-4d50-a73f-82c10a06a741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:10.173333 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e094c7e-58a1-4d50-a73f-82c10a06a741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:10.175188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85744fc-7b9e-435b-856c-e8405e860354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:10.175337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e094c7e-58a1-4d50-a73f-82c10a06a741 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:10.175813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85744fc-7b9e-435b-856c-e8405e860354 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:10.176089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85744fc-7b9e-435b-856c-e8405e860354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:10.176949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85744fc-7b9e-435b-856c-e8405e860354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:10.177645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85744fc-7b9e-435b-856c-e8405e860354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:10.179255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85744fc-7b9e-435b-856c-e8405e860354 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:10.188769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1130/2273] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:10.189722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1144/2274] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:10.193597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094c7e-58a1-4d50-a73f-82c10a06a741 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:10.194329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85744fc-7b9e-435b-856c-e8405e860354 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:10.205463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e094c7e-58a1-4d50-a73f-82c10a06a741 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:10.206271 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85744fc-7b9e-435b-856c-e8405e860354 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:10.211311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdf788-c373-426a-aaa3-35094634c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:10.211483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19757dc3-4124-4e24-8493-694db7963504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:10.212201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757dc3-4124-4e24-8493-694db7963504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:10.212329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdf788-c373-426a-aaa3-35094634c28a admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:10.212717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757dc3-4124-4e24-8493-694db7963504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:10.213142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdf788-c373-426a-aaa3-35094634c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:10.213142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafdf788-c373-426a-aaa3-35094634c28a admin admin] PATH_INFO: `/v3/projects/e251ef63a07840498f6fbde1b6a5fa27/users/27666d500143473ca34b3b0578d443a8/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:10.213302 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19757dc3-4124-4e24-8493-694db7963504 admin admin] PATH_INFO: `/v3/projects/5049adc875fc45b389101348b86ab614/users/1144bdcfba6e414d9a50e262ae0607d5/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:10.215065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdf788-c373-426a-aaa3-35094634c28a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e251ef63a07840498f6fbde1b6a5fa27, user_id=27666d500143473ca34b3b0578d443a8, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:10.217788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafdf788-c373-426a-aaa3-35094634c28a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:10.229896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19757dc3-4124-4e24-8493-694db7963504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5049adc875fc45b389101348b86ab614, user_id=1144bdcfba6e414d9a50e262ae0607d5, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:10.232806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19757dc3-4124-4e24-8493-694db7963504 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:10.236248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1145/2275] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:10 2022] PUT /identity/v3/projects/e251ef63a07840498f6fbde1b6a5fa27/users/27666d500143473ca34b3b0578d443a8/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:10.251925 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1131/2276] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:10 2022] PUT /identity/v3/projects/5049adc875fc45b389101348b86ab614/users/1144bdcfba6e414d9a50e262ae0607d5/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:10.253567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdf788-c373-426a-aaa3-35094634c28a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:10.337839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafdf788-c373-426a-aaa3-35094634c28a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:10.396207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:10.408542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b01ecf-bb68-4c9e-a51e-6ffbb073c9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:10.409314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b01ecf-bb68-4c9e-a51e-6ffbb073c9fa admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:10.409619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b01ecf-bb68-4c9e-a51e-6ffbb073c9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:10.409899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b01ecf-bb68-4c9e-a51e-6ffbb073c9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:10.411137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b01ecf-bb68-4c9e-a51e-6ffbb073c9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:10.412834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b01ecf-bb68-4c9e-a51e-6ffbb073c9fa admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:10.425321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1146/2277] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:10 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:10.429767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19757dc3-4124-4e24-8493-694db7963504 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:10.441980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19757dc3-4124-4e24-8493-694db7963504 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:10.447861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266620fc-bfc0-428c-a5ab-eb73c92b8b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:10.448819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266620fc-bfc0-428c-a5ab-eb73c92b8b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:10.449256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266620fc-bfc0-428c-a5ab-eb73c92b8b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:10.449596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266620fc-bfc0-428c-a5ab-eb73c92b8b04 admin admin] PATH_INFO: `/v3/projects/5049adc875fc45b389101348b86ab614/users/1144bdcfba6e414d9a50e262ae0607d5/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:10.451708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266620fc-bfc0-428c-a5ab-eb73c92b8b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5049adc875fc45b389101348b86ab614, user_id=1144bdcfba6e414d9a50e262ae0607d5, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:10.454415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266620fc-bfc0-428c-a5ab-eb73c92b8b04 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:10.465378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1132/2278] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:10 2022] PUT /identity/v3/projects/5049adc875fc45b389101348b86ab614/users/1144bdcfba6e414d9a50e262ae0607d5/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:12.471339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b01ecf-bb68-4c9e-a51e-6ffbb073c9fa admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:12.473791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e1b01ecf-bb68-4c9e-a51e-6ffbb073c9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:12.497155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b01ecf-bb68-4c9e-a51e-6ffbb073c9fa admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:12.580566 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:12.581233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:12.581536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:12.582441 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] PATH_INFO: `/v3/users/ac0c8efc0b3e44ec83bce1426bf73887` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:12.584316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac0c8efc0b3e44ec83bce1426bf73887)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:12.586382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:12.682637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac0c8efc0b3e44ec83bce1426bf73887'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.708968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac0c8efc0b3e44ec83bce1426bf73887'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.719758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac0c8efc0b3e44ec83bce1426bf73887'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.720652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac0c8efc0b3e44ec83bce1426bf73887'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.721192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac0c8efc0b3e44ec83bce1426bf73887'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.757418 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1147/2279] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:12 2022] DELETE /identity/v3/users/ac0c8efc0b3e44ec83bce1426bf73887 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:12.758147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9463e6-6495-44a6-bbb6-c3579c7b5085 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:12.758640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9463e6-6495-44a6-bbb6-c3579c7b5085 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:12.758734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9463e6-6495-44a6-bbb6-c3579c7b5085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:12.791640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-2e9463e6-6495-44a6-bbb6-c3579c7b5085 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:12.792973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2e9463e6-6495-44a6-bbb6-c3579c7b5085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:12.934196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1133/2280] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:12.949206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:12.952357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:13.119292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3840b5-0b26-4d2d-b5b8-62c3300e29a6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:13.126444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b130d-b610-4d9c-a877-252f0ba004db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:13.127640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b130d-b610-4d9c-a877-252f0ba004db service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:13.128197 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b130d-b610-4d9c-a877-252f0ba004db service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:13.128707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b130d-b610-4d9c-a877-252f0ba004db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:13.163138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b130d-b610-4d9c-a877-252f0ba004db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:13.165898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b130d-b610-4d9c-a877-252f0ba004db service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:13.186183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1148/2281] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:14.095735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9463e6-6495-44a6-bbb6-c3579c7b5085 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:14.097357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2e9463e6-6495-44a6-bbb6-c3579c7b5085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:14.124748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9463e6-6495-44a6-bbb6-c3579c7b5085 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:14.142803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:14.143596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:14.143963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:14.144480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] PATH_INFO: `/v3/projects/f98870499e274cdc8451a2a4216a4cbe` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:14.155490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f98870499e274cdc8451a2a4216a4cbe)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:14.157676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:14.283381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f98870499e274cdc8451a2a4216a4cbe', 'request_id': 'req-f594f8cd-3fe3-4a8f-9809-185e61e5f573'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.307668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f98870499e274cdc8451a2a4216a4cbe', 'request_id': 'req-f594f8cd-3fe3-4a8f-9809-185e61e5f573'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.318292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f98870499e274cdc8451a2a4216a4cbe', 'request_id': 'req-f594f8cd-3fe3-4a8f-9809-185e61e5f573'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.342906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] The token cache is being invalidate because project f98870499e274cdc8451a2a4216a4cbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:14.343222 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.344496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f594f8cd-3fe3-4a8f-9809-185e61e5f573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.346517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1134/2282] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:14 2022] DELETE /identity/v3/projects/f98870499e274cdc8451a2a4216a4cbe => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:14.351931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400aec9-f788-4274-9e0a-265b309c7ad5 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:14.352510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400aec9-f788-4274-9e0a-265b309c7ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:14.352510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400aec9-f788-4274-9e0a-265b309c7ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:14.400502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0400aec9-f788-4274-9e0a-265b309c7ad5 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:14.404849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0400aec9-f788-4274-9e0a-265b309c7ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:14.432111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:14.618538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1149/2283] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:14.626148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d92f0a-19b3-4d88-9c59-bead05bd6009 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:14.626451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d92f0a-19b3-4d88-9c59-bead05bd6009 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:14.626716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d92f0a-19b3-4d88-9c59-bead05bd6009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:14.667432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-58d92f0a-19b3-4d88-9c59-bead05bd6009 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:14.668697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-58d92f0a-19b3-4d88-9c59-bead05bd6009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:14.701962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1135/2284] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:14.703537 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400aec9-f788-4274-9e0a-265b309c7ad5 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:14.718840 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400aec9-f788-4274-9e0a-265b309c7ad5 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:14.731819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b79d7d-3f73-4c7a-a053-53305fda3083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:14.732112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79d7d-3f73-4c7a-a053-53305fda3083 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:14.732846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79d7d-3f73-4c7a-a053-53305fda3083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:14.732846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79d7d-3f73-4c7a-a053-53305fda3083 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:14.733570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b79d7d-3f73-4c7a-a053-53305fda3083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:14.733910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b79d7d-3f73-4c7a-a053-53305fda3083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:14.742419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b79d7d-3f73-4c7a-a053-53305fda3083 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:14.782298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1150/2285] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:43:14.787538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d92f0a-19b3-4d88-9c59-bead05bd6009 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:14.809731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d92f0a-19b3-4d88-9c59-bead05bd6009 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:14.824971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a89d2-40d1-4c84-8bbb-5cc81910cb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:14.825778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a89d2-40d1-4c84-8bbb-5cc81910cb24 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:14.826430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a89d2-40d1-4c84-8bbb-5cc81910cb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:14.827339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a89d2-40d1-4c84-8bbb-5cc81910cb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:14.830200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a89d2-40d1-4c84-8bbb-5cc81910cb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:14.832322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a89d2-40d1-4c84-8bbb-5cc81910cb24 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:14.856322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:14.909206 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1136/2286] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:14 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:14.910946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b79d7d-3f73-4c7a-a053-53305fda3083 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:14.928744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b79d7d-3f73-4c7a-a053-53305fda3083 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.077326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf025f-6a4b-4520-8e62-3cd7fc343e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.077970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf025f-6a4b-4520-8e62-3cd7fc343e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.078256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf025f-6a4b-4520-8e62-3cd7fc343e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.078531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf025f-6a4b-4520-8e62-3cd7fc343e59 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.079190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf025f-6a4b-4520-8e62-3cd7fc343e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.081359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf025f-6a4b-4520-8e62-3cd7fc343e59 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.163358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1151/2287] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:14 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:15.164667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a89d2-40d1-4c84-8bbb-5cc81910cb24 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.178625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a89d2-40d1-4c84-8bbb-5cc81910cb24 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.190530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3d8e-f486-4a3d-a50b-e1a527ae54cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.191174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3d8e-f486-4a3d-a50b-e1a527ae54cf admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.191454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3d8e-f486-4a3d-a50b-e1a527ae54cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.192300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c3d8e-f486-4a3d-a50b-e1a527ae54cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.193012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3d8e-f486-4a3d-a50b-e1a527ae54cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.200689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c3d8e-f486-4a3d-a50b-e1a527ae54cf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.235792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1137/2288] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:15.236389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf025f-6a4b-4520-8e62-3cd7fc343e59 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.249718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf025f-6a4b-4520-8e62-3cd7fc343e59 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.274338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b2de5-2107-4c17-93cc-bce53b669562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.275619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b2de5-2107-4c17-93cc-bce53b669562 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.275619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b2de5-2107-4c17-93cc-bce53b669562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.284564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b2de5-2107-4c17-93cc-bce53b669562 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.288694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b2de5-2107-4c17-93cc-bce53b669562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.290412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b2de5-2107-4c17-93cc-bce53b669562 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.339229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1152/2289] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:43:15.343446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3d8e-f486-4a3d-a50b-e1a527ae54cf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.359537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c3d8e-f486-4a3d-a50b-e1a527ae54cf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.380178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e9fec-eeab-43cd-888f-bd09438b85d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.381130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9fec-eeab-43cd-888f-bd09438b85d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.383381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9fec-eeab-43cd-888f-bd09438b85d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.384350 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9fec-eeab-43cd-888f-bd09438b85d4 admin admin] PATH_INFO: `/v3/projects/7c581529052c4ef3bb5a7c7a901b4bbf/users/ee2fdcf479fb45d48fd312c20857d10f/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.453373 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e9fec-eeab-43cd-888f-bd09438b85d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c581529052c4ef3bb5a7c7a901b4bbf, user_id=ee2fdcf479fb45d48fd312c20857d10f, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.456092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e9fec-eeab-43cd-888f-bd09438b85d4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.509499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1138/2290] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:15 2022] PUT /identity/v3/projects/7c581529052c4ef3bb5a7c7a901b4bbf/users/ee2fdcf479fb45d48fd312c20857d10f/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:15.520709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64761478-029b-444d-9586-6a9ecba79bef None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.521330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64761478-029b-444d-9586-6a9ecba79bef None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.521330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64761478-029b-444d-9586-6a9ecba79bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.623647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-64761478-029b-444d-9586-6a9ecba79bef None None] MFA Rules not processed for user `ee2fdcf479fb45d48fd312c20857d10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:15.626421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-64761478-029b-444d-9586-6a9ecba79bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:15.839800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1153/2291] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:15.858131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e9fec-eeab-43cd-888f-bd09438b85d4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.859956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-550e9fec-eeab-43cd-888f-bd09438b85d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:16.061608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e9fec-eeab-43cd-888f-bd09438b85d4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:16.078703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463b81-b728-4a09-b5cd-e7b291cc5f6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cd62eb975492aab4a136c0e9825a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:16.079610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463b81-b728-4a09-b5cd-e7b291cc5f6d service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:16.080054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463b81-b728-4a09-b5cd-e7b291cc5f6d service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:16.080511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c463b81-b728-4a09-b5cd-e7b291cc5f6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:16.109863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c463b81-b728-4a09-b5cd-e7b291cc5f6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:16.111608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c463b81-b728-4a09-b5cd-e7b291cc5f6d service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:16.130507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1139/2292] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:17.762368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2034-6949-4e01-a4c3-cf431bc86a63 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:17.762762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2034-6949-4e01-a4c3-cf431bc86a63 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:17.763037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b2034-6949-4e01-a4c3-cf431bc86a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:17.784781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:17.820014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6c8b2034-6949-4e01-a4c3-cf431bc86a63 None None] MFA Rules not processed for user `27666d500143473ca34b3b0578d443a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:17.821801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6c8b2034-6949-4e01-a4c3-cf431bc86a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:17.918793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1154/2293] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:17.940730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463b81-b728-4a09-b5cd-e7b291cc5f6d service glance] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:17.942319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7c463b81-b728-4a09-b5cd-e7b291cc5f6d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:18.065936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c463b81-b728-4a09-b5cd-e7b291cc5f6d service glance] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:18.072331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488523f-0c97-429c-adad-2ca65351a561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:18.073104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488523f-0c97-429c-adad-2ca65351a561 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:18.073343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488523f-0c97-429c-adad-2ca65351a561 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:18.073625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488523f-0c97-429c-adad-2ca65351a561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:18.075683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4488523f-0c97-429c-adad-2ca65351a561 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:18.226438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:18.231239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488523f-0c97-429c-adad-2ca65351a561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:18.234607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488523f-0c97-429c-adad-2ca65351a561 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:18.270487 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1140/2294] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:19.104520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29178bb-fdc5-47e0-9e35-4c043f6404de None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:19.105048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29178bb-fdc5-47e0-9e35-4c043f6404de None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:19.105168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29178bb-fdc5-47e0-9e35-4c043f6404de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:19.137425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c29178bb-fdc5-47e0-9e35-4c043f6404de None None] MFA Rules not processed for user `1144bdcfba6e414d9a50e262ae0607d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:19.138943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c29178bb-fdc5-47e0-9e35-4c043f6404de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:19.251088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1155/2295] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:19.375160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488523f-0c97-429c-adad-2ca65351a561 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:19.389930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488523f-0c97-429c-adad-2ca65351a561 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:19.409005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce996ec0-419a-425c-815a-d896201b4698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:19.409664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce996ec0-419a-425c-815a-d896201b4698 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:19.409948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce996ec0-419a-425c-815a-d896201b4698 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:19.410269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce996ec0-419a-425c-815a-d896201b4698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:19.412278 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ce996ec0-419a-425c-815a-d896201b4698 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:19.498221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce996ec0-419a-425c-815a-d896201b4698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:19.499966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce996ec0-419a-425c-815a-d896201b4698 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:19.511232 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1141/2296] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:20.917687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390aa55f-7713-464b-b028-d93382446860 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:20.918219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390aa55f-7713-464b-b028-d93382446860 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:20.918219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390aa55f-7713-464b-b028-d93382446860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:20.944286 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-390aa55f-7713-464b-b028-d93382446860 None None] MFA Rules not processed for user `228eefac4dab4b5d937bf66ea6e0eb8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:20.945858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-390aa55f-7713-464b-b028-d93382446860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:20.958753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1156/2297] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:29.506015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=31 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:30.938010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=68 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:44.934771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774d16-7979-4662-a707-0ac8c95eef02 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.935373 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774d16-7979-4662-a707-0ac8c95eef02 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.935476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774d16-7979-4662-a707-0ac8c95eef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.954678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-35774d16-7979-4662-a707-0ac8c95eef02 None None] MFA Rules not processed for user `c9f838395a2247e49e0acacd0fdadb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:44.956731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-35774d16-7979-4662-a707-0ac8c95eef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:45.012076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1142/2298] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:43:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:46.133500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390aa55f-7713-464b-b028-d93382446860 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:46.134959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-390aa55f-7713-464b-b028-d93382446860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:46.205283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390aa55f-7713-464b-b028-d93382446860 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:46.210122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d07d-9a96-40c0-ba82-e368417a671e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:46.210737 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d07d-9a96-40c0-ba82-e368417a671e service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:46.211025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d07d-9a96-40c0-ba82-e368417a671e service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:46.211295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d07d-9a96-40c0-ba82-e368417a671e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:46.213060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2615d07d-9a96-40c0-ba82-e368417a671e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:46.224492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615d07d-9a96-40c0-ba82-e368417a671e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:46.226075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615d07d-9a96-40c0-ba82-e368417a671e service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:46.235635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1157/2299] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:55.005209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=25 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:56.231627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=32 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:09.202436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5d996-154f-43e8-9182-99762eaf9e47 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:09.202956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5d996-154f-43e8-9182-99762eaf9e47 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:09.203053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5d996-154f-43e8-9182-99762eaf9e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:09.223572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e0b5d996-154f-43e8-9182-99762eaf9e47 None None] MFA Rules not processed for user `5377fd0bccf748dda1d0192080253dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:09.225154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e0b5d996-154f-43e8-9182-99762eaf9e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:09.233317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1143/2300] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:44:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:18.694745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d07d-9a96-40c0-ba82-e368417a671e service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:18.757663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d07d-9a96-40c0-ba82-e368417a671e service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:18.762149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:18.762790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:18.763178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:18.763454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] PATH_INFO: `/v3/users/ee2fdcf479fb45d48fd312c20857d10f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:18.764655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2fdcf479fb45d48fd312c20857d10f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:18.766554 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:18.843534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2fdcf479fb45d48fd312c20857d10f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:18.866744 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2fdcf479fb45d48fd312c20857d10f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:18.873865 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2fdcf479fb45d48fd312c20857d10f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:18.874776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2fdcf479fb45d48fd312c20857d10f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:18.875390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2fdcf479fb45d48fd312c20857d10f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:18.890981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1158/2301] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:44:18 2022] DELETE /identity/v3/users/ee2fdcf479fb45d48fd312c20857d10f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:44:18.896109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870c3fa-61dc-4b7d-9edd-b86535a9a1a5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:18.896594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870c3fa-61dc-4b7d-9edd-b86535a9a1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:18.896795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5870c3fa-61dc-4b7d-9edd-b86535a9a1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:18.916798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5870c3fa-61dc-4b7d-9edd-b86535a9a1a5 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:18.918322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5870c3fa-61dc-4b7d-9edd-b86535a9a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:18.979603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1144/2302] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:18.989464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:18.990880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:19.047010 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81691-73ad-49e1-ab3b-c6363403b5e7 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:19.051291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54d959-5c39-4812-8339-e6463a57e588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:19.051901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d959-5c39-4812-8339-e6463a57e588 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.052214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d959-5c39-4812-8339-e6463a57e588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.052491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54d959-5c39-4812-8339-e6463a57e588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.061594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54d959-5c39-4812-8339-e6463a57e588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:19.063086 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54d959-5c39-4812-8339-e6463a57e588 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:19.073117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1159/2303] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:44:19.340466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870c3fa-61dc-4b7d-9edd-b86535a9a1a5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:19.341854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5870c3fa-61dc-4b7d-9edd-b86535a9a1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:19.354748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5870c3fa-61dc-4b7d-9edd-b86535a9a1a5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:19.359549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:19.360230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.360511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.360784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] PATH_INFO: `/v3/projects/7c581529052c4ef3bb5a7c7a901b4bbf` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.361968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c581529052c4ef3bb5a7c7a901b4bbf)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:19.364530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:19.415663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c581529052c4ef3bb5a7c7a901b4bbf', 'request_id': 'req-f8891cb9-892a-4edc-8ea5-adf0784c39f7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:19.427021 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c581529052c4ef3bb5a7c7a901b4bbf', 'request_id': 'req-f8891cb9-892a-4edc-8ea5-adf0784c39f7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:19.434996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c581529052c4ef3bb5a7c7a901b4bbf', 'request_id': 'req-f8891cb9-892a-4edc-8ea5-adf0784c39f7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:19.452442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] The token cache is being invalidate because project 7c581529052c4ef3bb5a7c7a901b4bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:44:19.452734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:19.453384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f8891cb9-892a-4edc-8ea5-adf0784c39f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:19.455047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1145/2304] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:44:19 2022] DELETE /identity/v3/projects/7c581529052c4ef3bb5a7c7a901b4bbf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:44:19.460647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1853a-2251-43fd-a577-d40ed0bd51d9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.460965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1853a-2251-43fd-a577-d40ed0bd51d9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.461397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1853a-2251-43fd-a577-d40ed0bd51d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.481375 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f5f1853a-2251-43fd-a577-d40ed0bd51d9 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:19.483995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f5f1853a-2251-43fd-a577-d40ed0bd51d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:19.502245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:19.549650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1160/2305] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:19.557464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9b00-692a-45e5-b24f-de43ce68d15b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.557763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9b00-692a-45e5-b24f-de43ce68d15b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.558042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd9b00-692a-45e5-b24f-de43ce68d15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.577828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5bbd9b00-692a-45e5-b24f-de43ce68d15b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:19.579032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5bbd9b00-692a-45e5-b24f-de43ce68d15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:19.587516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1146/2306] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:19.591713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1853a-2251-43fd-a577-d40ed0bd51d9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:19.601231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1853a-2251-43fd-a577-d40ed0bd51d9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:19.606591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bdcc6-1a2f-430d-b5d8-1ca2a3486498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:19.607209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bdcc6-1a2f-430d-b5d8-1ca2a3486498 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.607482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bdcc6-1a2f-430d-b5d8-1ca2a3486498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.607750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bdcc6-1a2f-430d-b5d8-1ca2a3486498 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.608482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bdcc6-1a2f-430d-b5d8-1ca2a3486498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:44:19.608784 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bdcc6-1a2f-430d-b5d8-1ca2a3486498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:19.610391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bdcc6-1a2f-430d-b5d8-1ca2a3486498 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:19.621634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1161/2307] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:44:19.625757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9b00-692a-45e5-b24f-de43ce68d15b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:19.635403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd9b00-692a-45e5-b24f-de43ce68d15b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:19.640024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1685-670d-423f-b684-9ae1026acfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:19.640976 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1685-670d-423f-b684-9ae1026acfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.641258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1685-670d-423f-b684-9ae1026acfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.641530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e1685-670d-423f-b684-9ae1026acfc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.642190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e1685-670d-423f-b684-9ae1026acfc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:19.644827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e1685-670d-423f-b684-9ae1026acfc4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:19.671533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1147/2308] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:44:19 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:44:19.675930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bdcc6-1a2f-430d-b5d8-1ca2a3486498 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:19.685978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bdcc6-1a2f-430d-b5d8-1ca2a3486498 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:19.742761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f57ee-1fce-487d-ac0e-6b8b43621299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:19.743368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f57ee-1fce-487d-ac0e-6b8b43621299 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.743590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f57ee-1fce-487d-ac0e-6b8b43621299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.743873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f57ee-1fce-487d-ac0e-6b8b43621299 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.744577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f57ee-1fce-487d-ac0e-6b8b43621299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:19.746520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f57ee-1fce-487d-ac0e-6b8b43621299 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:19.767450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1162/2309] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:44:19 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:44:19.772315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1685-670d-423f-b684-9ae1026acfc4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:19.785294 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e1685-670d-423f-b684-9ae1026acfc4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:19.790012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d53845-75fc-42a2-af3c-9cf3c4935553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:19.790613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d53845-75fc-42a2-af3c-9cf3c4935553 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.790893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d53845-75fc-42a2-af3c-9cf3c4935553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.791324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d53845-75fc-42a2-af3c-9cf3c4935553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.792019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d53845-75fc-42a2-af3c-9cf3c4935553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:19.793625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d53845-75fc-42a2-af3c-9cf3c4935553 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:19.803656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1148/2310] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:44:19.807799 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f57ee-1fce-487d-ac0e-6b8b43621299 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:19.817808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f57ee-1fce-487d-ac0e-6b8b43621299 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:19.822354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d23e8c-530a-464e-8857-bc210523b95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:19.822954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d23e8c-530a-464e-8857-bc210523b95c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.823234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d23e8c-530a-464e-8857-bc210523b95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.823506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d23e8c-530a-464e-8857-bc210523b95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.824221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d23e8c-530a-464e-8857-bc210523b95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:19.825801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d23e8c-530a-464e-8857-bc210523b95c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:19.836514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1163/2311] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:44:19.840467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d53845-75fc-42a2-af3c-9cf3c4935553 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:19.851125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d53845-75fc-42a2-af3c-9cf3c4935553 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:19.856030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a5e4-fc5f-4a41-949c-e08b2386ed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:19.856708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a5e4-fc5f-4a41-949c-e08b2386ed4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.856991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a5e4-fc5f-4a41-949c-e08b2386ed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.857264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a5e4-fc5f-4a41-949c-e08b2386ed4a admin admin] PATH_INFO: `/v3/projects/3979a5306e3a42099fc55e6dc557ddef/users/e9f7f3fbebef4428a4ed70b807d34e18/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.871385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a5e4-fc5f-4a41-949c-e08b2386ed4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3979a5306e3a42099fc55e6dc557ddef, user_id=e9f7f3fbebef4428a4ed70b807d34e18, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:19.874029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a5e4-fc5f-4a41-949c-e08b2386ed4a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:19.886455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1149/2312] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:44:19 2022] PUT /identity/v3/projects/3979a5306e3a42099fc55e6dc557ddef/users/e9f7f3fbebef4428a4ed70b807d34e18/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:44:19.896938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1be45-6218-45bf-bed7-c88a16594505 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:19.897229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1be45-6218-45bf-bed7-c88a16594505 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:19.897510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1be45-6218-45bf-bed7-c88a16594505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:19.925487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-88f1be45-6218-45bf-bed7-c88a16594505 None None] MFA Rules not processed for user `e9f7f3fbebef4428a4ed70b807d34e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:19.926708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-88f1be45-6218-45bf-bed7-c88a16594505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:20.001471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1164/2313] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:44:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:20.012704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a5e4-fc5f-4a41-949c-e08b2386ed4a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:20.014639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-54c3a5e4-fc5f-4a41-949c-e08b2386ed4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:20.040003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:20.102161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a5e4-fc5f-4a41-949c-e08b2386ed4a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:20.107480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521af58-4f4c-4238-8751-e6d7c587ca85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:20.108318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521af58-4f4c-4238-8751-e6d7c587ca85 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:20.108687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521af58-4f4c-4238-8751-e6d7c587ca85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:20.109063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521af58-4f4c-4238-8751-e6d7c587ca85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:20.119695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521af58-4f4c-4238-8751-e6d7c587ca85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:20.121179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521af58-4f4c-4238-8751-e6d7c587ca85 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:20.133775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1150/2314] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:44:23.084567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee94363-03db-4a76-9537-bdc43aa24839 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:23.085502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee94363-03db-4a76-9537-bdc43aa24839 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:23.086143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee94363-03db-4a76-9537-bdc43aa24839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:23.110048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-cee94363-03db-4a76-9537-bdc43aa24839 None None] MFA Rules not processed for user `e477f5953a534355b29c071086846ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:23.111795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cee94363-03db-4a76-9537-bdc43aa24839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:23.128598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:23.204775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1165/2315] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:44:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:28.582212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52804-3d20-4c4b-ba3a-fd561c0408d9 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:28.583083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52804-3d20-4c4b-ba3a-fd561c0408d9 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:28.583362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf52804-3d20-4c4b-ba3a-fd561c0408d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:28.610019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dbf52804-3d20-4c4b-ba3a-fd561c0408d9 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:28.611717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dbf52804-3d20-4c4b-ba3a-fd561c0408d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:28.677525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1151/2316] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:44:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:28.730525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee94363-03db-4a76-9537-bdc43aa24839 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:28.732007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cee94363-03db-4a76-9537-bdc43aa24839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:28.811626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee94363-03db-4a76-9537-bdc43aa24839 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:28.818116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b919ec-a7a4-4308-a066-a7e9ec02ea6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:28.818761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b919ec-a7a4-4308-a066-a7e9ec02ea6e service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:28.819642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b919ec-a7a4-4308-a066-a7e9ec02ea6e service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:28.819642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b919ec-a7a4-4308-a066-a7e9ec02ea6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:28.836784 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b919ec-a7a4-4308-a066-a7e9ec02ea6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:28.838474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b919ec-a7a4-4308-a066-a7e9ec02ea6e service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:28.847616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1166/2317] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:44:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:44:32.093251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52804-3d20-4c4b-ba3a-fd561c0408d9 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:32.269993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf52804-3d20-4c4b-ba3a-fd561c0408d9 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:32.286204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:32.286793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:32.290014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:32.290896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] PATH_INFO: `/v3/users/e9f7f3fbebef4428a4ed70b807d34e18` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:32.293175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f7f3fbebef4428a4ed70b807d34e18)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:32.296355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:32.415989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f7f3fbebef4428a4ed70b807d34e18'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:32.425743 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f7f3fbebef4428a4ed70b807d34e18'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:32.437855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f7f3fbebef4428a4ed70b807d34e18'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:32.438891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f7f3fbebef4428a4ed70b807d34e18'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:32.439555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f7f3fbebef4428a4ed70b807d34e18'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:32.441638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:32.465060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1152/2318] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:44:32 2022] DELETE /identity/v3/users/e9f7f3fbebef4428a4ed70b807d34e18 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:44:32.470259 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82d7d3-f8aa-4c7c-8d2a-b2e0d04e4641 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:32.471333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82d7d3-f8aa-4c7c-8d2a-b2e0d04e4641 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:32.471830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82d7d3-f8aa-4c7c-8d2a-b2e0d04e4641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:32.495588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ae82d7d3-f8aa-4c7c-8d2a-b2e0d04e4641 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:32.497255 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ae82d7d3-f8aa-4c7c-8d2a-b2e0d04e4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:32.605106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:32.607802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:32.610280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1167/2319] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:32.695061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8e121-5cd0-4a2b-8720-62eec688131e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:32.700702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b14bb8-1d3b-4ccb-b10c-2db03f78385c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:32.701511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b14bb8-1d3b-4ccb-b10c-2db03f78385c service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:32.701906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b14bb8-1d3b-4ccb-b10c-2db03f78385c service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:32.702349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b14bb8-1d3b-4ccb-b10c-2db03f78385c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:32.726601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b14bb8-1d3b-4ccb-b10c-2db03f78385c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:32.728992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b14bb8-1d3b-4ccb-b10c-2db03f78385c service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:32.741267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1153/2320] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:44:33.726016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82d7d3-f8aa-4c7c-8d2a-b2e0d04e4641 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:33.727691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ae82d7d3-f8aa-4c7c-8d2a-b2e0d04e4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:33.747823 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82d7d3-f8aa-4c7c-8d2a-b2e0d04e4641 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:33.760203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:33.760844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:33.761128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:33.761405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] PATH_INFO: `/v3/projects/3979a5306e3a42099fc55e6dc557ddef` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:33.764423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3979a5306e3a42099fc55e6dc557ddef)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:33.766421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:33.876082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:33.877926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3979a5306e3a42099fc55e6dc557ddef', 'request_id': 'req-1968c6d4-ce57-4359-a5b3-b3548a8efb67'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:33.886530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3979a5306e3a42099fc55e6dc557ddef', 'request_id': 'req-1968c6d4-ce57-4359-a5b3-b3548a8efb67'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:33.897951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3979a5306e3a42099fc55e6dc557ddef', 'request_id': 'req-1968c6d4-ce57-4359-a5b3-b3548a8efb67'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:33.912521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] The token cache is being invalidate because project 3979a5306e3a42099fc55e6dc557ddef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:44:33.912791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:33.914521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1968c6d4-ce57-4359-a5b3-b3548a8efb67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:44:33.924793 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1168/2321] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:44:33 2022] DELETE /identity/v3/projects/3979a5306e3a42099fc55e6dc557ddef => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:44:42.736866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=33,keystone:DELETE=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:43.907953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=7,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:47.942698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa92699-9ba2-4bd1-a0ea-14f94653da98 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:47.943231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa92699-9ba2-4bd1-a0ea-14f94653da98 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:47.943231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa92699-9ba2-4bd1-a0ea-14f94653da98 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:47.944530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1154/2322] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:44:47.951721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf889a-6b96-4946-9171-350c9f115d48 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:47.952303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf889a-6b96-4946-9171-350c9f115d48 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:47.952729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf889a-6b96-4946-9171-350c9f115d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:47.975796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d3cf889a-6b96-4946-9171-350c9f115d48 None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:47.977257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d3cf889a-6b96-4946-9171-350c9f115d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:48.053421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1169/2323] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:44:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:48.071613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa92699-9ba2-4bd1-a0ea-14f94653da98 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:48.073416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4aa92699-9ba2-4bd1-a0ea-14f94653da98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:48.154604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa92699-9ba2-4bd1-a0ea-14f94653da98 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:48.159779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba1866-121f-4f77-96ca-7c1a52470831 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cd62eb975492aab4a136c0e9825a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:48.160437 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba1866-121f-4f77-96ca-7c1a52470831 service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:48.160833 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba1866-121f-4f77-96ca-7c1a52470831 service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:48.161111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba1866-121f-4f77-96ca-7c1a52470831 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:48.173779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba1866-121f-4f77-96ca-7c1a52470831 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:48.175326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba1866-121f-4f77-96ca-7c1a52470831 service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:48.188545 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1155/2324] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:44:48.274566 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b012-4370-42fc-b958-aed7c3376b88 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:48.274566 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b012-4370-42fc-b958-aed7c3376b88 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:48.274896 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b012-4370-42fc-b958-aed7c3376b88 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:48.277154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1170/2325] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:44:48.282978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf69f0-390f-4616-a260-65ddcaf4f446 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:48.283340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf69f0-390f-4616-a260-65ddcaf4f446 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:48.283479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf69f0-390f-4616-a260-65ddcaf4f446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:48.305170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4ddf69f0-390f-4616-a260-65ddcaf4f446 None None] MFA Rules not processed for user `24644cede7e149a6b3e5bd39b930017b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:48.306402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4ddf69f0-390f-4616-a260-65ddcaf4f446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:48.373983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1156/2326] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:48.395811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b012-4370-42fc-b958-aed7c3376b88 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:48.400976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d398b012-4370-42fc-b958-aed7c3376b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:48.423966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b012-4370-42fc-b958-aed7c3376b88 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:48.431714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c80ca-7bd6-46fc-b16c-cbb9d73dc7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:48.432379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c80ca-7bd6-46fc-b16c-cbb9d73dc7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:48.432673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c80ca-7bd6-46fc-b16c-cbb9d73dc7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:48.432948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c80ca-7bd6-46fc-b16c-cbb9d73dc7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:48.446333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c80ca-7bd6-46fc-b16c-cbb9d73dc7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:48.448846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c80ca-7bd6-46fc-b16c-cbb9d73dc7d8 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:48.457842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1171/2327] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:44:48.572527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd21a4-12af-4008-8900-8647b99add78 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:48.572816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd21a4-12af-4008-8900-8647b99add78 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:48.573120 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd21a4-12af-4008-8900-8647b99add78 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:48.574477 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1157/2328] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:44:48.579541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7804ed-860f-4b90-9aed-979497ce6d2b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:48.580567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7804ed-860f-4b90-9aed-979497ce6d2b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:48.580848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7804ed-860f-4b90-9aed-979497ce6d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:48.600268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1b7804ed-860f-4b90-9aed-979497ce6d2b None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:48.601503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1b7804ed-860f-4b90-9aed-979497ce6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:48.612529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1172/2329] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:48.623615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd21a4-12af-4008-8900-8647b99add78 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:48.634923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd21a4-12af-4008-8900-8647b99add78 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:48.639176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87768ae-baa0-4ff6-b76d-4f330a89873f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:48.639793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87768ae-baa0-4ff6-b76d-4f330a89873f service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:48.640172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87768ae-baa0-4ff6-b76d-4f330a89873f service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:48.640444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87768ae-baa0-4ff6-b76d-4f330a89873f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:48.652310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87768ae-baa0-4ff6-b76d-4f330a89873f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:48.653743 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87768ae-baa0-4ff6-b76d-4f330a89873f service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:48.664757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1158/2330] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:44:49.773075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7804ed-860f-4b90-9aed-979497ce6d2b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:49.774476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1b7804ed-860f-4b90-9aed-979497ce6d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:49.786777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7804ed-860f-4b90-9aed-979497ce6d2b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:49.790649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b908336-1736-4455-8149-9e5eb41cb3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:49.791280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b908336-1736-4455-8149-9e5eb41cb3ea service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:49.791561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b908336-1736-4455-8149-9e5eb41cb3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:49.791835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b908336-1736-4455-8149-9e5eb41cb3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:49.793962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4b908336-1736-4455-8149-9e5eb41cb3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:49.859861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b908336-1736-4455-8149-9e5eb41cb3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:49.861359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b908336-1736-4455-8149-9e5eb41cb3ea service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:49.871164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1173/2331] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:44:52.408995 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87768ae-baa0-4ff6-b76d-4f330a89873f service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:52.417640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87768ae-baa0-4ff6-b76d-4f330a89873f service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:52.421260 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:52.421863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:52.422140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:52.422412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:52.424167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:52.488467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:52.489927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:52.500593 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1159/2332] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:44:54.280329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e94e3-b9ee-43be-805f-3a7605475c12 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:54.280799 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e94e3-b9ee-43be-805f-3a7605475c12 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:54.280889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e94e3-b9ee-43be-805f-3a7605475c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:54.300631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-664e94e3-b9ee-43be-805f-3a7605475c12 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:54.301945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-664e94e3-b9ee-43be-805f-3a7605475c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:54.359061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1174/2333] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:44:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:54.371428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:54.373118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:54.409942 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:54.443920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e9532-b03d-44d3-9d1f-509ceb043145 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:54.448881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2fc6d-2a8b-47be-9817-f77763954f93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:54.449497 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2fc6d-2a8b-47be-9817-f77763954f93 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:54.449778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2fc6d-2a8b-47be-9817-f77763954f93 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:54.450053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2fc6d-2a8b-47be-9817-f77763954f93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:54.458787 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2fc6d-2a8b-47be-9817-f77763954f93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:54.460447 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2fc6d-2a8b-47be-9817-f77763954f93 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:54.468603 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1160/2334] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:44:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:44:58.736838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e94e3-b9ee-43be-805f-3a7605475c12 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:58.746026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e94e3-b9ee-43be-805f-3a7605475c12 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:58.749580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:58.750186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:58.750464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:58.750746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:58.752498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:58.766294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:58.768277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:58.773633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:58.781147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1175/2335] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:44:59.980918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2fc6d-2a8b-47be-9817-f77763954f93 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:59.991046 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2fc6d-2a8b-47be-9817-f77763954f93 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:59.994705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4569e-dffe-4b4c-b02b-e631cb8ceaee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:59.995398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4569e-dffe-4b4c-b02b-e631cb8ceaee service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:59.995683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4569e-dffe-4b4c-b02b-e631cb8ceaee service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:59.995966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4569e-dffe-4b4c-b02b-e631cb8ceaee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:59.997772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-73f4569e-dffe-4b4c-b02b-e631cb8ceaee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:45:00.011618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4569e-dffe-4b4c-b02b-e631cb8ceaee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:45:00.013085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4569e-dffe-4b4c-b02b-e631cb8ceaee service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:45:00.024916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1161/2336] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:45:08.782204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:10.019506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=23 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:13.003151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:45:13.004701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:45:13.018812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd28824-4460-40b3-a4d7-4a745dba2a19 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:45:13.024814 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63047f4-2fbe-4430-857c-e132a564547c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:45:13.025421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63047f4-2fbe-4430-857c-e132a564547c service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:45:13.025706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63047f4-2fbe-4430-857c-e132a564547c service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:45:13.025980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63047f4-2fbe-4430-857c-e132a564547c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:45:13.027700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b63047f4-2fbe-4430-857c-e132a564547c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:45:13.085618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63047f4-2fbe-4430-857c-e132a564547c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:45:13.087191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63047f4-2fbe-4430-857c-e132a564547c service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:45:13.097040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1176/2337] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:45:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:45:23.092137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=28 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:24.075430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4569e-dffe-4b4c-b02b-e631cb8ceaee service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:45:24.084700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4569e-dffe-4b4c-b02b-e631cb8ceaee service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:45:24.088385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f648a7-36c7-488f-8dcf-213b9f0f3e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:45:24.089004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f648a7-36c7-488f-8dcf-213b9f0f3e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:45:24.089283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f648a7-36c7-488f-8dcf-213b9f0f3e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:45:24.089548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f648a7-36c7-488f-8dcf-213b9f0f3e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:45:24.091269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-89f648a7-36c7-488f-8dcf-213b9f0f3e65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:45:24.100567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f648a7-36c7-488f-8dcf-213b9f0f3e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:45:24.101986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f648a7-36c7-488f-8dcf-213b9f0f3e65 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:45:24.110480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1162/2338] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:45:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:45:27.638360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb95709-8182-46d6-aafd-d086185e1801 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:45:27.638838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb95709-8182-46d6-aafd-d086185e1801 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:45:27.638941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb95709-8182-46d6-aafd-d086185e1801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:45:27.658584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9cb95709-8182-46d6-aafd-d086185e1801 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:45:27.659795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9cb95709-8182-46d6-aafd-d086185e1801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:45:27.666906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1177/2339] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 2 21:45:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:45:27.680043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f648a7-36c7-488f-8dcf-213b9f0f3e65 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:45:27.692255 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f648a7-36c7-488f-8dcf-213b9f0f3e65 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:45:27.697256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a318-9957-4be4-9fbf-39ac2547ccb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:45:27.697872 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a318-9957-4be4-9fbf-39ac2547ccb6 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:45:27.698151 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a318-9957-4be4-9fbf-39ac2547ccb6 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:45:27.698427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7a318-9957-4be4-9fbf-39ac2547ccb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:45:27.707435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a318-9957-4be4-9fbf-39ac2547ccb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:45:27.709195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7a318-9957-4be4-9fbf-39ac2547ccb6 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:45:27.717191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1163/2340] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:45:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:45:37.652728 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:37.713964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=12 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:07.742043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9a4f0-123b-4116-90d8-add7b42fb70a None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:07.742563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9a4f0-123b-4116-90d8-add7b42fb70a None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:07.742563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc9a4f0-123b-4116-90d8-add7b42fb70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:07.764161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-3bc9a4f0-123b-4116-90d8-add7b42fb70a None None] MFA Rules not processed for user `c9f838395a2247e49e0acacd0fdadb2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:07.765960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3bc9a4f0-123b-4116-90d8-add7b42fb70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:07.822030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1178/2341] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:46:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:13.971211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a318-9957-4be4-9fbf-39ac2547ccb6 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:13.972881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7cd7a318-9957-4be4-9fbf-39ac2547ccb6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:13.990058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7a318-9957-4be4-9fbf-39ac2547ccb6 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:13.997836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31a7b-d2b6-4388-9c56-fa4c313c6749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:13.998487 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31a7b-d2b6-4388-9c56-fa4c313c6749 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:13.998770 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31a7b-d2b6-4388-9c56-fa4c313c6749 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:13.999043 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e31a7b-d2b6-4388-9c56-fa4c313c6749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:14.000822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c7e31a7b-d2b6-4388-9c56-fa4c313c6749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:14.013358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e31a7b-d2b6-4388-9c56-fa4c313c6749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:14.015472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e31a7b-d2b6-4388-9c56-fa4c313c6749 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:14.026168 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1164/2342] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:17.815337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=25 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:23.563591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9a4f0-123b-4116-90d8-add7b42fb70a None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:23.576635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc9a4f0-123b-4116-90d8-add7b42fb70a None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:23.581956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79ffd-decd-4470-be64-e15de79b857a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:23.582587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79ffd-decd-4470-be64-e15de79b857a service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:23.582861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79ffd-decd-4470-be64-e15de79b857a service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:23.583129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a79ffd-decd-4470-be64-e15de79b857a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:23.584879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-46a79ffd-decd-4470-be64-e15de79b857a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:23.641128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79ffd-decd-4470-be64-e15de79b857a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:23.642705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a79ffd-decd-4470-be64-e15de79b857a service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:23.651799 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1179/2343] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:24.021732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:25.593865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31a7b-d2b6-4388-9c56-fa4c313c6749 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:25.605079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e31a7b-d2b6-4388-9c56-fa4c313c6749 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:25.611202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153b609-43b4-48ee-ba16-c0eba76eae4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:25.611799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153b609-43b4-48ee-ba16-c0eba76eae4d service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:25.612077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153b609-43b4-48ee-ba16-c0eba76eae4d service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:25.612381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153b609-43b4-48ee-ba16-c0eba76eae4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:25.614103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1153b609-43b4-48ee-ba16-c0eba76eae4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:25.671291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153b609-43b4-48ee-ba16-c0eba76eae4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:25.672918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153b609-43b4-48ee-ba16-c0eba76eae4d service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:25.681938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1165/2344] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:28.827549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79ffd-decd-4470-be64-e15de79b857a service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.839268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a79ffd-decd-4470-be64-e15de79b857a service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.845623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eabff-8378-43bf-b0e0-9e39ebc15ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.846254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eabff-8378-43bf-b0e0-9e39ebc15ad9 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.846573 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eabff-8378-43bf-b0e0-9e39ebc15ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.846851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eabff-8378-43bf-b0e0-9e39ebc15ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.848828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8f2eabff-8378-43bf-b0e0-9e39ebc15ad9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:28.862777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2eabff-8378-43bf-b0e0-9e39ebc15ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.864518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2eabff-8378-43bf-b0e0-9e39ebc15ad9 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.876283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1180/2345] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:35.677628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=28 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:37.643261 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1312b-8478-40ce-bc1d-afdcca9f16bb None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:37.643875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1312b-8478-40ce-bc1d-afdcca9f16bb None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:37.643875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf1312b-8478-40ce-bc1d-afdcca9f16bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:37.662753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-cdf1312b-8478-40ce-bc1d-afdcca9f16bb None None] MFA Rules not processed for user `e477f5953a534355b29c071086846ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:37.663959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cdf1312b-8478-40ce-bc1d-afdcca9f16bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:37.671002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1166/2346] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:37.971805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eabff-8378-43bf-b0e0-9e39ebc15ad9 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:37.980898 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eabff-8378-43bf-b0e0-9e39ebc15ad9 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:37.985068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3d411-b39c-4fce-81ab-f963bcb8cb4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:37.985669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3d411-b39c-4fce-81ab-f963bcb8cb4a service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:37.985951 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3d411-b39c-4fce-81ab-f963bcb8cb4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:37.986221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3d411-b39c-4fce-81ab-f963bcb8cb4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:37.987980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-26c3d411-b39c-4fce-81ab-f963bcb8cb4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:37.997281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3d411-b39c-4fce-81ab-f963bcb8cb4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:37.998695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3d411-b39c-4fce-81ab-f963bcb8cb4a service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:38.006514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1181/2347] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:39.335611 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1312b-8478-40ce-bc1d-afdcca9f16bb None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:39.337669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-cdf1312b-8478-40ce-bc1d-afdcca9f16bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:39.407538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf1312b-8478-40ce-bc1d-afdcca9f16bb None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:39.412392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add33df-0c70-47b4-9dbc-18048bd4782e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:39.412999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add33df-0c70-47b4-9dbc-18048bd4782e service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:39.413285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add33df-0c70-47b4-9dbc-18048bd4782e service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:39.413557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add33df-0c70-47b4-9dbc-18048bd4782e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:39.415262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9add33df-0c70-47b4-9dbc-18048bd4782e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:39.426146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add33df-0c70-47b4-9dbc-18048bd4782e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:39.427720 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add33df-0c70-47b4-9dbc-18048bd4782e service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:39.437721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1167/2348] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:47.729706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3d411-b39c-4fce-81ab-f963bcb8cb4a service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:47.751294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3d411-b39c-4fce-81ab-f963bcb8cb4a service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:47.757446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1db5e-65fb-4947-8ec0-14e7de944a9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:47.758079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1db5e-65fb-4947-8ec0-14e7de944a9f service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:47.758494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1db5e-65fb-4947-8ec0-14e7de944a9f service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:47.758781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1db5e-65fb-4947-8ec0-14e7de944a9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:47.760592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-edf1db5e-65fb-4947-8ec0-14e7de944a9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:47.774660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1db5e-65fb-4947-8ec0-14e7de944a9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:47.776380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1db5e-65fb-4947-8ec0-14e7de944a9f service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:47.788053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1182/2349] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:49.433191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=35 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:54.734556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4070c-1224-48d7-8187-1ec073f7e0a2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:54.735112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4070c-1224-48d7-8187-1ec073f7e0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:54.735112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4070c-1224-48d7-8187-1ec073f7e0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:54.756128 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-32d4070c-1224-48d7-8187-1ec073f7e0a2 None None] MFA Rules not processed for user `57e8eced4d8d49458668a52761e9b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:54.757363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-32d4070c-1224-48d7-8187-1ec073f7e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:54.764508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1168/2350] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:46:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:55.071415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1db5e-65fb-4947-8ec0-14e7de944a9f service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:55.075845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=47 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:55.082121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1db5e-65fb-4947-8ec0-14e7de944a9f service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:55.085872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dbdb9-076a-45db-9830-3cafdfafda56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:55.086476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dbdb9-076a-45db-9830-3cafdfafda56 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:55.086754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dbdb9-076a-45db-9830-3cafdfafda56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:55.087066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064dbdb9-076a-45db-9830-3cafdfafda56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:55.088828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-064dbdb9-076a-45db-9830-3cafdfafda56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:55.098621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dbdb9-076a-45db-9830-3cafdfafda56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:55.100117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064dbdb9-076a-45db-9830-3cafdfafda56 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:55.108601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1183/2351] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:04.749893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:05.104387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:12.479272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4070c-1224-48d7-8187-1ec073f7e0a2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:12.481204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-32d4070c-1224-48d7-8187-1ec073f7e0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:12.536612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4070c-1224-48d7-8187-1ec073f7e0a2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:12.540192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597a1ad-486e-403b-98bd-87c1a46daeaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:12.540799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597a1ad-486e-403b-98bd-87c1a46daeaa service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.541080 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597a1ad-486e-403b-98bd-87c1a46daeaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.541353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597a1ad-486e-403b-98bd-87c1a46daeaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.543557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6597a1ad-486e-403b-98bd-87c1a46daeaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:12.554141 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597a1ad-486e-403b-98bd-87c1a46daeaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:12.555555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597a1ad-486e-403b-98bd-87c1a46daeaa service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:12.565017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1169/2352] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:22.561067 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=26 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:34.746406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dbdb9-076a-45db-9830-3cafdfafda56 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:34.755600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064dbdb9-076a-45db-9830-3cafdfafda56 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:34.759312 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c99f2-6580-44f2-8bae-63ab37e6f094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:34.759928 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c99f2-6580-44f2-8bae-63ab37e6f094 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:34.760263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c99f2-6580-44f2-8bae-63ab37e6f094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:34.760545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c99f2-6580-44f2-8bae-63ab37e6f094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:34.762313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-661c99f2-6580-44f2-8bae-63ab37e6f094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:34.826811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c99f2-6580-44f2-8bae-63ab37e6f094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:34.828287 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c99f2-6580-44f2-8bae-63ab37e6f094 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:34.839329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1184/2353] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:37.381765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e1b71-ac4e-4d00-9bea-819fe48cb03c None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:37.382258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e1b71-ac4e-4d00-9bea-819fe48cb03c None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:37.382358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e1b71-ac4e-4d00-9bea-819fe48cb03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:37.400973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b05e1b71-ac4e-4d00-9bea-819fe48cb03c None None] MFA Rules not processed for user `5377fd0bccf748dda1d0192080253dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:37.402184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b05e1b71-ac4e-4d00-9bea-819fe48cb03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:37.458242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1170/2354] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:38.200939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612d623-7d42-48f4-a764-b956bd434b36 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.202505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612d623-7d42-48f4-a764-b956bd434b36 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.203159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612d623-7d42-48f4-a764-b956bd434b36 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:38.204786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1185/2355] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:47:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:47:38.235814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411cf54-a826-496f-9ac2-ef6f4553e883 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.236061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411cf54-a826-496f-9ac2-ef6f4553e883 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.236393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411cf54-a826-496f-9ac2-ef6f4553e883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:38.258230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0411cf54-a826-496f-9ac2-ef6f4553e883 None None] MFA Rules not processed for user `ad52cba0b761482d96b6659654034ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:38.260768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0411cf54-a826-496f-9ac2-ef6f4553e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:38.276370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1171/2356] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:47:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:38.308213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612d623-7d42-48f4-a764-b956bd434b36 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:38.325459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a612d623-7d42-48f4-a764-b956bd434b36 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:38.332040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894f18e-8774-445e-b212-081193d6276d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:38.332868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894f18e-8774-445e-b212-081193d6276d service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.332987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894f18e-8774-445e-b212-081193d6276d service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.333341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894f18e-8774-445e-b212-081193d6276d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:38.340460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411cf54-a826-496f-9ac2-ef6f4553e883 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:38.342379 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0411cf54-a826-496f-9ac2-ef6f4553e883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:38.344877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894f18e-8774-445e-b212-081193d6276d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:38.346861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894f18e-8774-445e-b212-081193d6276d service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:38.366778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411cf54-a826-496f-9ac2-ef6f4553e883 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:38.372580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:38.373612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.374415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.374864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] PATH_INFO: `/v3/users/c9f838395a2247e49e0acacd0fdadb2b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:38.376444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f838395a2247e49e0acacd0fdadb2b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:38.378136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1186/2357] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:38.391181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:38.487378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f838395a2247e49e0acacd0fdadb2b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.496871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f838395a2247e49e0acacd0fdadb2b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.508400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f838395a2247e49e0acacd0fdadb2b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.509152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f838395a2247e49e0acacd0fdadb2b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.512851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-1889ae75-53be-46f7-829d-edfa426dff19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f838395a2247e49e0acacd0fdadb2b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.540556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1172/2358] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:38 2022] DELETE /identity/v3/users/c9f838395a2247e49e0acacd0fdadb2b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:38.722392 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894f18e-8774-445e-b212-081193d6276d service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:38.733969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894f18e-8774-445e-b212-081193d6276d service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:38.803229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:38.803889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.804198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.804477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] PATH_INFO: `/v3/projects/ad2873976b194c2daf265f84f5e60519` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:38.805650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2873976b194c2daf265f84f5e60519)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:38.808244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:38.855372 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2873976b194c2daf265f84f5e60519', 'request_id': 'req-991c0c62-0cba-412a-b5bd-3796e8818f91'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.861833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2873976b194c2daf265f84f5e60519', 'request_id': 'req-991c0c62-0cba-412a-b5bd-3796e8818f91'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.869448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2873976b194c2daf265f84f5e60519', 'request_id': 'req-991c0c62-0cba-412a-b5bd-3796e8818f91'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.880351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] The token cache is being invalidate because project ad2873976b194c2daf265f84f5e60519 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:38.880643 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.881282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-991c0c62-0cba-412a-b5bd-3796e8818f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.883091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1187/2359] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:38 2022] DELETE /identity/v3/projects/ad2873976b194c2daf265f84f5e60519 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:38.888243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974d1b-1aa3-4a8c-bad5-e0df877d0693 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.888544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974d1b-1aa3-4a8c-bad5-e0df877d0693 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.888845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85974d1b-1aa3-4a8c-bad5-e0df877d0693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:38.910359 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-85974d1b-1aa3-4a8c-bad5-e0df877d0693 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:38.911473 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-85974d1b-1aa3-4a8c-bad5-e0df877d0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:38.972082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1173/2360] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:38.980959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93876b16-408e-40b6-9b49-4e5717e067b9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.981248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93876b16-408e-40b6-9b49-4e5717e067b9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.981578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93876b16-408e-40b6-9b49-4e5717e067b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.001100 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-93876b16-408e-40b6-9b49-4e5717e067b9 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:39.002310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93876b16-408e-40b6-9b49-4e5717e067b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:39.011084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1188/2361] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:39.015810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85974d1b-1aa3-4a8c-bad5-e0df877d0693 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.026870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85974d1b-1aa3-4a8c-bad5-e0df877d0693 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.031698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663c32-fc01-41f0-8fba-5327b5555853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.032438 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663c32-fc01-41f0-8fba-5327b5555853 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.032785 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663c32-fc01-41f0-8fba-5327b5555853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.033596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39663c32-fc01-41f0-8fba-5327b5555853 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.034490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663c32-fc01-41f0-8fba-5327b5555853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:39.035080 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663c32-fc01-41f0-8fba-5327b5555853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.036724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39663c32-fc01-41f0-8fba-5327b5555853 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.045136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:39.056170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1174/2362] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:39.057133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93876b16-408e-40b6-9b49-4e5717e067b9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.063817 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:39.068323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93876b16-408e-40b6-9b49-4e5717e067b9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.074653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347e95b-05d1-474a-8584-cf8399818b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.075448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347e95b-05d1-474a-8584-cf8399818b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.075953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347e95b-05d1-474a-8584-cf8399818b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.076274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347e95b-05d1-474a-8584-cf8399818b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.077033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347e95b-05d1-474a-8584-cf8399818b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.079089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347e95b-05d1-474a-8584-cf8399818b5c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.105555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1189/2363] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:39 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:39.109980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663c32-fc01-41f0-8fba-5327b5555853 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.120394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39663c32-fc01-41f0-8fba-5327b5555853 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.175869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f661b64-7437-4660-ae86-dc26c5b054b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.176433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661b64-7437-4660-ae86-dc26c5b054b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.176720 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661b64-7437-4660-ae86-dc26c5b054b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.176998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f661b64-7437-4660-ae86-dc26c5b054b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.177706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f661b64-7437-4660-ae86-dc26c5b054b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.179665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f661b64-7437-4660-ae86-dc26c5b054b5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.200683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1175/2364] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:39 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:39.204932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347e95b-05d1-474a-8584-cf8399818b5c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.215452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347e95b-05d1-474a-8584-cf8399818b5c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.219962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90857865-30ec-41c3-9d62-dba197eba626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.220598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857865-30ec-41c3-9d62-dba197eba626 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.220876 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857865-30ec-41c3-9d62-dba197eba626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.221146 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90857865-30ec-41c3-9d62-dba197eba626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.221832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90857865-30ec-41c3-9d62-dba197eba626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.223412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90857865-30ec-41c3-9d62-dba197eba626 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.233871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1190/2365] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:39.237778 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f661b64-7437-4660-ae86-dc26c5b054b5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.248109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f661b64-7437-4660-ae86-dc26c5b054b5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.252699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c836d0b-f5b5-4a59-b14a-95b6d85c5493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.253297 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836d0b-f5b5-4a59-b14a-95b6d85c5493 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.253579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836d0b-f5b5-4a59-b14a-95b6d85c5493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.253855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836d0b-f5b5-4a59-b14a-95b6d85c5493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.254545 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c836d0b-f5b5-4a59-b14a-95b6d85c5493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.256123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c836d0b-f5b5-4a59-b14a-95b6d85c5493 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.266599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1176/2366] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:39.270813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90857865-30ec-41c3-9d62-dba197eba626 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.281116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90857865-30ec-41c3-9d62-dba197eba626 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.285863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601fd68-1889-47ba-b228-94854138cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.286512 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601fd68-1889-47ba-b228-94854138cdc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.286797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601fd68-1889-47ba-b228-94854138cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.287075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601fd68-1889-47ba-b228-94854138cdc1 admin admin] PATH_INFO: `/v3/projects/2e46e89fc6564fe1ac8d957eea188b26/users/d555451425bd42f1b62159d9a7c09837/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.303469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601fd68-1889-47ba-b228-94854138cdc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e46e89fc6564fe1ac8d957eea188b26, user_id=d555451425bd42f1b62159d9a7c09837, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.306209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601fd68-1889-47ba-b228-94854138cdc1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.319217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1191/2367] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:39 2022] PUT /identity/v3/projects/2e46e89fc6564fe1ac8d957eea188b26/users/d555451425bd42f1b62159d9a7c09837/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:39.329370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa6ecf-f6f3-4284-8b45-210822ea2e7a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.329657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa6ecf-f6f3-4284-8b45-210822ea2e7a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.329978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa6ecf-f6f3-4284-8b45-210822ea2e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.358597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-42fa6ecf-f6f3-4284-8b45-210822ea2e7a None None] MFA Rules not processed for user `d555451425bd42f1b62159d9a7c09837`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:39.359825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-42fa6ecf-f6f3-4284-8b45-210822ea2e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:39.427805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1177/2368] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:39.440066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601fd68-1889-47ba-b228-94854138cdc1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.449794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5601fd68-1889-47ba-b228-94854138cdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:39.545580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601fd68-1889-47ba-b228-94854138cdc1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.551828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4fe1f3-2c3c-480b-b67c-3f20ad0c572e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.552504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe1f3-2c3c-480b-b67c-3f20ad0c572e service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.552918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe1f3-2c3c-480b-b67c-3f20ad0c572e service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.553055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4fe1f3-2c3c-480b-b67c-3f20ad0c572e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.563054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fe1f3-2c3c-480b-b67c-3f20ad0c572e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.564895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4fe1f3-2c3c-480b-b67c-3f20ad0c572e service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.579030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1192/2369] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:42.428924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa6ecf-f6f3-4284-8b45-210822ea2e7a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.504072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa6ecf-f6f3-4284-8b45-210822ea2e7a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.509025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.509700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.509981 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.510259 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] PATH_INFO: `/v3/users/d555451425bd42f1b62159d9a7c09837` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.511500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d555451425bd42f1b62159d9a7c09837)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.513519 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.519840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:42.564881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd555451425bd42f1b62159d9a7c09837'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.571549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd555451425bd42f1b62159d9a7c09837'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.578104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd555451425bd42f1b62159d9a7c09837'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.578827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd555451425bd42f1b62159d9a7c09837'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.579432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd555451425bd42f1b62159d9a7c09837'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.596500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1178/2370] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:42 2022] DELETE /identity/v3/users/d555451425bd42f1b62159d9a7c09837 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:42.600953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159eb741-b2e2-463a-b8fa-049a9f2e0411 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.601413 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159eb741-b2e2-463a-b8fa-049a9f2e0411 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.601534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159eb741-b2e2-463a-b8fa-049a9f2e0411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.621818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-159eb741-b2e2-463a-b8fa-049a9f2e0411 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:42.623154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-159eb741-b2e2-463a-b8fa-049a9f2e0411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.680156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1193/2371] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:42.690378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.691808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.749622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4deed-a71d-433a-8701-0a8f00166bd4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.754506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40a0f0-0a6b-4090-94eb-84c17eeeecda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.755060 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40a0f0-0a6b-4090-94eb-84c17eeeecda service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.755344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40a0f0-0a6b-4090-94eb-84c17eeeecda service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.755619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40a0f0-0a6b-4090-94eb-84c17eeeecda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.765381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40a0f0-0a6b-4090-94eb-84c17eeeecda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.766825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe40a0f0-0a6b-4090-94eb-84c17eeeecda service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.776786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1179/2372] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:43.068106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159eb741-b2e2-463a-b8fa-049a9f2e0411 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.069601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-159eb741-b2e2-463a-b8fa-049a9f2e0411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.086214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159eb741-b2e2-463a-b8fa-049a9f2e0411 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.092985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.093631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.093918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.094187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] PATH_INFO: `/v3/projects/2e46e89fc6564fe1ac8d957eea188b26` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.095359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e46e89fc6564fe1ac8d957eea188b26)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.097337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.131330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:43.151133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e46e89fc6564fe1ac8d957eea188b26', 'request_id': 'req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.157499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e46e89fc6564fe1ac8d957eea188b26', 'request_id': 'req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.164991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e46e89fc6564fe1ac8d957eea188b26', 'request_id': 'req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.178942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] The token cache is being invalidate because project 2e46e89fc6564fe1ac8d957eea188b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:43.179483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.180578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7ab1e6d4-1326-427d-9c82-556fb4ecacf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.183806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1194/2373] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:43 2022] DELETE /identity/v3/projects/2e46e89fc6564fe1ac8d957eea188b26 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:43.188843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fbfce-58f6-4f23-b5f2-827d2ddb1ecd None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.189136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fbfce-58f6-4f23-b5f2-827d2ddb1ecd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.189413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fbfce-58f6-4f23-b5f2-827d2ddb1ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.209917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-014fbfce-58f6-4f23-b5f2-827d2ddb1ecd None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:43.211205 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-014fbfce-58f6-4f23-b5f2-827d2ddb1ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.269906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1180/2374] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:43.278422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dfb6b-94d3-46d7-a31c-14b9aa7cf6bf None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.278711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dfb6b-94d3-46d7-a31c-14b9aa7cf6bf None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.278986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78dfb6b-94d3-46d7-a31c-14b9aa7cf6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.298150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f78dfb6b-94d3-46d7-a31c-14b9aa7cf6bf None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:43.299347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f78dfb6b-94d3-46d7-a31c-14b9aa7cf6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.307809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1195/2375] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:43.311883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fbfce-58f6-4f23-b5f2-827d2ddb1ecd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.322032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fbfce-58f6-4f23-b5f2-827d2ddb1ecd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.326514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b847f-6c22-4e65-a8b1-69e882f9263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.327106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b847f-6c22-4e65-a8b1-69e882f9263b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.327384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b847f-6c22-4e65-a8b1-69e882f9263b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.327653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b847f-6c22-4e65-a8b1-69e882f9263b admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.328394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b847f-6c22-4e65-a8b1-69e882f9263b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:43.328699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b847f-6c22-4e65-a8b1-69e882f9263b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.330274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b847f-6c22-4e65-a8b1-69e882f9263b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.342127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1181/2376] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:43.346131 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dfb6b-94d3-46d7-a31c-14b9aa7cf6bf None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.355342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78dfb6b-94d3-46d7-a31c-14b9aa7cf6bf None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.359950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadf8af-5298-4be1-98f6-ae31bf72bfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.360593 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadf8af-5298-4be1-98f6-ae31bf72bfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.360878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadf8af-5298-4be1-98f6-ae31bf72bfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.361154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deadf8af-5298-4be1-98f6-ae31bf72bfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.361826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadf8af-5298-4be1-98f6-ae31bf72bfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.363734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deadf8af-5298-4be1-98f6-ae31bf72bfc7 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.393913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1196/2377] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:43.398347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b847f-6c22-4e65-a8b1-69e882f9263b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.408993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b847f-6c22-4e65-a8b1-69e882f9263b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.420571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:43.476122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb48e5d-eea3-4405-a64b-8027ca0ce625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.476792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb48e5d-eea3-4405-a64b-8027ca0ce625 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.477036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb48e5d-eea3-4405-a64b-8027ca0ce625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.477302 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb48e5d-eea3-4405-a64b-8027ca0ce625 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.477977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb48e5d-eea3-4405-a64b-8027ca0ce625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.479873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb48e5d-eea3-4405-a64b-8027ca0ce625 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.506342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1182/2378] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/users => generated 285 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:43.507856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadf8af-5298-4be1-98f6-ae31bf72bfc7 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.520489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deadf8af-5298-4be1-98f6-ae31bf72bfc7 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.528631 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d22e4-8193-403a-92c4-f0f149ceed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.529272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d22e4-8193-403a-92c4-f0f149ceed4e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.529616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d22e4-8193-403a-92c4-f0f149ceed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.530046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d22e4-8193-403a-92c4-f0f149ceed4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.530761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d22e4-8193-403a-92c4-f0f149ceed4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.533235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d22e4-8193-403a-92c4-f0f149ceed4e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.551505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1197/2379] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:43.557595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb48e5d-eea3-4405-a64b-8027ca0ce625 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.568564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb48e5d-eea3-4405-a64b-8027ca0ce625 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.573769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084f794-3bcf-4671-b533-e1e89d47284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.574379 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084f794-3bcf-4671-b533-e1e89d47284d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.574658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084f794-3bcf-4671-b533-e1e89d47284d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.574929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084f794-3bcf-4671-b533-e1e89d47284d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.575621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084f794-3bcf-4671-b533-e1e89d47284d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.577249 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084f794-3bcf-4671-b533-e1e89d47284d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.587899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1183/2380] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:43.592019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d22e4-8193-403a-92c4-f0f149ceed4e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.602009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d22e4-8193-403a-92c4-f0f149ceed4e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.606717 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f2c4-245b-420f-86a5-a9d569d8e81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.607369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f2c4-245b-420f-86a5-a9d569d8e81e admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.607647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f2c4-245b-420f-86a5-a9d569d8e81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.607916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f2c4-245b-420f-86a5-a9d569d8e81e admin admin] PATH_INFO: `/v3/projects/37d973518f1042a59dcaee331e4ac414/users/6fec5a29f6f546adac3187897e899c46/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.622599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f2c4-245b-420f-86a5-a9d569d8e81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d973518f1042a59dcaee331e4ac414, user_id=6fec5a29f6f546adac3187897e899c46, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.625988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f2c4-245b-420f-86a5-a9d569d8e81e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.638654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1198/2381] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:43 2022] PUT /identity/v3/projects/37d973518f1042a59dcaee331e4ac414/users/6fec5a29f6f546adac3187897e899c46/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:43.650400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d491108-409d-455b-82a4-ba7def5d3b91 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.650687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d491108-409d-455b-82a4-ba7def5d3b91 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.650959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d491108-409d-455b-82a4-ba7def5d3b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.677470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0d491108-409d-455b-82a4-ba7def5d3b91 None None] MFA Rules not processed for user `6fec5a29f6f546adac3187897e899c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:43.678671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0d491108-409d-455b-82a4-ba7def5d3b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.740885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1184/2382] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:43.745874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f2c4-245b-420f-86a5-a9d569d8e81e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.806421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f2c4-245b-420f-86a5-a9d569d8e81e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.811052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ec48a-8a4b-43a6-9e87-ede5502b4e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.811659 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ec48a-8a4b-43a6-9e87-ede5502b4e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.811935 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ec48a-8a4b-43a6-9e87-ede5502b4e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.812243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ec48a-8a4b-43a6-9e87-ede5502b4e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.812905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ec48a-8a4b-43a6-9e87-ede5502b4e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.814786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ec48a-8a4b-43a6-9e87-ede5502b4e73 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.840695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1199/2383] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:43.844774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d491108-409d-455b-82a4-ba7def5d3b91 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.855863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d491108-409d-455b-82a4-ba7def5d3b91 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.911881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670f23f-c6bd-457c-8390-0fbf601b9da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.912528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670f23f-c6bd-457c-8390-0fbf601b9da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.912813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670f23f-c6bd-457c-8390-0fbf601b9da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.913092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670f23f-c6bd-457c-8390-0fbf601b9da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.913786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670f23f-c6bd-457c-8390-0fbf601b9da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.916335 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670f23f-c6bd-457c-8390-0fbf601b9da5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.939753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1185/2384] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:43.940992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ec48a-8a4b-43a6-9e87-ede5502b4e73 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.951906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ec48a-8a4b-43a6-9e87-ede5502b4e73 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.956547 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac548d6-2001-4d8b-a1a4-3e1afbc9adf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.957153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac548d6-2001-4d8b-a1a4-3e1afbc9adf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.957437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac548d6-2001-4d8b-a1a4-3e1afbc9adf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.957714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac548d6-2001-4d8b-a1a4-3e1afbc9adf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.958413 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac548d6-2001-4d8b-a1a4-3e1afbc9adf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.960027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac548d6-2001-4d8b-a1a4-3e1afbc9adf0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.970873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1200/2385] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:43.974889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670f23f-c6bd-457c-8390-0fbf601b9da5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.984724 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670f23f-c6bd-457c-8390-0fbf601b9da5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.989898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68174f60-95db-4a45-bb4a-931ad6b61a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.990575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68174f60-95db-4a45-bb4a-931ad6b61a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.990859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68174f60-95db-4a45-bb4a-931ad6b61a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.991135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68174f60-95db-4a45-bb4a-931ad6b61a6e admin admin] PATH_INFO: `/v3/projects/c8d5dde8ff6a45848582344d48c9bb87/users/400f4f02e7634457b3185ed607081ef1/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.002153 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:44.006568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68174f60-95db-4a45-bb4a-931ad6b61a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d5dde8ff6a45848582344d48c9bb87, user_id=400f4f02e7634457b3185ed607081ef1, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.010612 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68174f60-95db-4a45-bb4a-931ad6b61a6e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.023403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1186/2386] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:43 2022] PUT /identity/v3/projects/c8d5dde8ff6a45848582344d48c9bb87/users/400f4f02e7634457b3185ed607081ef1/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:44.028703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac548d6-2001-4d8b-a1a4-3e1afbc9adf0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.038735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac548d6-2001-4d8b-a1a4-3e1afbc9adf0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.062497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:44.097644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e743d6aa-0144-4e29-800d-fa940aaab361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.098254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d6aa-0144-4e29-800d-fa940aaab361 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.098538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d6aa-0144-4e29-800d-fa940aaab361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.098810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e743d6aa-0144-4e29-800d-fa940aaab361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.099501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743d6aa-0144-4e29-800d-fa940aaab361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.101116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e743d6aa-0144-4e29-800d-fa940aaab361 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.110661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1201/2387] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:44.114835 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68174f60-95db-4a45-bb4a-931ad6b61a6e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.126132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68174f60-95db-4a45-bb4a-931ad6b61a6e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.130685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488dded-4888-4dbb-bde8-d6bf631880f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.131331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dded-4888-4dbb-bde8-d6bf631880f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.131628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dded-4888-4dbb-bde8-d6bf631880f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.131881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488dded-4888-4dbb-bde8-d6bf631880f5 admin admin] PATH_INFO: `/v3/projects/c8d5dde8ff6a45848582344d48c9bb87/users/400f4f02e7634457b3185ed607081ef1/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.134343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488dded-4888-4dbb-bde8-d6bf631880f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d5dde8ff6a45848582344d48c9bb87, user_id=400f4f02e7634457b3185ed607081ef1, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.136969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488dded-4888-4dbb-bde8-d6bf631880f5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.147263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1187/2388] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:44 2022] PUT /identity/v3/projects/c8d5dde8ff6a45848582344d48c9bb87/users/400f4f02e7634457b3185ed607081ef1/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:44.158201 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d33806-a0d0-4030-99f6-4bfe459e1091 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.158487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d33806-a0d0-4030-99f6-4bfe459e1091 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.158760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d33806-a0d0-4030-99f6-4bfe459e1091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.185473 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-91d33806-a0d0-4030-99f6-4bfe459e1091 None None] MFA Rules not processed for user `400f4f02e7634457b3185ed607081ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:44.186672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-91d33806-a0d0-4030-99f6-4bfe459e1091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:44.253443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1202/2389] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:44.264655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488dded-4888-4dbb-bde8-d6bf631880f5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.266334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6488dded-4888-4dbb-bde8-d6bf631880f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:44.325239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488dded-4888-4dbb-bde8-d6bf631880f5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.328744 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f396ba-6dbe-4a0f-becf-b8fa45c834ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.329398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f396ba-6dbe-4a0f-becf-b8fa45c834ac service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.329674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f396ba-6dbe-4a0f-becf-b8fa45c834ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.329942 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f396ba-6dbe-4a0f-becf-b8fa45c834ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.339349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f396ba-6dbe-4a0f-becf-b8fa45c834ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.340806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f396ba-6dbe-4a0f-becf-b8fa45c834ac service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.351305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1188/2390] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:45.709316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d33806-a0d0-4030-99f6-4bfe459e1091 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.771930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d33806-a0d0-4030-99f6-4bfe459e1091 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:45.776794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:45.777445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.777729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.778004 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] PATH_INFO: `/v3/users/6fec5a29f6f546adac3187897e899c46` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.779167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fec5a29f6f546adac3187897e899c46)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.781138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:45.839657 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fec5a29f6f546adac3187897e899c46'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.842922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:45.863498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fec5a29f6f546adac3187897e899c46'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.871386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fec5a29f6f546adac3187897e899c46'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.872283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fec5a29f6f546adac3187897e899c46'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.872980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fec5a29f6f546adac3187897e899c46'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.897250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1203/2391] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:45 2022] DELETE /identity/v3/users/6fec5a29f6f546adac3187897e899c46 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:45.902475 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869713c-1ac7-4eb5-a1af-d7e8d6d60fbc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.903003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869713c-1ac7-4eb5-a1af-d7e8d6d60fbc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.903244 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869713c-1ac7-4eb5-a1af-d7e8d6d60fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.930084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c869713c-1ac7-4eb5-a1af-d7e8d6d60fbc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:45.932102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c869713c-1ac7-4eb5-a1af-d7e8d6d60fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.000682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1189/2392] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:46.013628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.015403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.075362 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07bac2-e333-49fa-bc86-cb62b762df38 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.079128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd242be-b880-4d1a-a5a0-94216aae6381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.079750 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd242be-b880-4d1a-a5a0-94216aae6381 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.080034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd242be-b880-4d1a-a5a0-94216aae6381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.080358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd242be-b880-4d1a-a5a0-94216aae6381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.090096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd242be-b880-4d1a-a5a0-94216aae6381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.091552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd242be-b880-4d1a-a5a0-94216aae6381 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.100981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1204/2393] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:46.385746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869713c-1ac7-4eb5-a1af-d7e8d6d60fbc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.387451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c869713c-1ac7-4eb5-a1af-d7e8d6d60fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.417737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869713c-1ac7-4eb5-a1af-d7e8d6d60fbc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.422858 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.423809 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.424035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.424333 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] PATH_INFO: `/v3/projects/37d973518f1042a59dcaee331e4ac414` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.425497 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d973518f1042a59dcaee331e4ac414)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.427692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.476077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d973518f1042a59dcaee331e4ac414', 'request_id': 'req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.484506 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d973518f1042a59dcaee331e4ac414', 'request_id': 'req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.490779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d973518f1042a59dcaee331e4ac414', 'request_id': 'req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.501215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] The token cache is being invalidate because project 37d973518f1042a59dcaee331e4ac414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:46.501680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.502397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.504063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1190/2394] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:46 2022] DELETE /identity/v3/projects/37d973518f1042a59dcaee331e4ac414 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:46.508326 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd242be-b880-4d1a-a5a0-94216aae6381 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.519264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd242be-b880-4d1a-a5a0-94216aae6381 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.575505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.576151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.576443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.576713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] PATH_INFO: `/v3/users/400f4f02e7634457b3185ed607081ef1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.577860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400f4f02e7634457b3185ed607081ef1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.579761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.625425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400f4f02e7634457b3185ed607081ef1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.639101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400f4f02e7634457b3185ed607081ef1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.644699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:46.646894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400f4f02e7634457b3185ed607081ef1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.647880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400f4f02e7634457b3185ed607081ef1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.648889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3c7a4ac2-d488-4bb9-9364-09c1ea985bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400f4f02e7634457b3185ed607081ef1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.662301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1205/2395] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:46 2022] DELETE /identity/v3/users/400f4f02e7634457b3185ed607081ef1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:46.936921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.938362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.948892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:46.957136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0bae80-7b1a-4ff6-baf3-c96d43f00f80 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.022252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.022904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.023526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.023526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] PATH_INFO: `/v3/projects/c8d5dde8ff6a45848582344d48c9bb87` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.025645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d5dde8ff6a45848582344d48c9bb87)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.027651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.082254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d5dde8ff6a45848582344d48c9bb87', 'request_id': 'req-48374ffc-836c-44dc-b246-518d9ee3182e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.091570 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d5dde8ff6a45848582344d48c9bb87', 'request_id': 'req-48374ffc-836c-44dc-b246-518d9ee3182e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.099028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d5dde8ff6a45848582344d48c9bb87', 'request_id': 'req-48374ffc-836c-44dc-b246-518d9ee3182e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.111137 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] The token cache is being invalidate because project c8d5dde8ff6a45848582344d48c9bb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:47.111433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.112079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-48374ffc-836c-44dc-b246-518d9ee3182e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.117195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1191/2396] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:46 2022] DELETE /identity/v3/projects/c8d5dde8ff6a45848582344d48c9bb87 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:47.119517 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a9cf-4ef4-4566-a896-6a451aa6787c None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.120052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a9cf-4ef4-4566-a896-6a451aa6787c None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.120405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5a9cf-4ef4-4566-a896-6a451aa6787c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.145458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0dd5a9cf-4ef4-4566-a896-6a451aa6787c None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:47.146863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0dd5a9cf-4ef4-4566-a896-6a451aa6787c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.206310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1206/2397] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:47.214781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d1fd1-709f-4eb7-ad77-93bcb039e2a0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.215069 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d1fd1-709f-4eb7-ad77-93bcb039e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.215377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d1fd1-709f-4eb7-ad77-93bcb039e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.234825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-b19d1fd1-709f-4eb7-ad77-93bcb039e2a0 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:47.236019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b19d1fd1-709f-4eb7-ad77-93bcb039e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.244776 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1192/2398] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:47.250317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a9cf-4ef4-4566-a896-6a451aa6787c None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.260289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5a9cf-4ef4-4566-a896-6a451aa6787c None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.264753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a970c5e-60dd-4766-996a-1f9a8cd70521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.265360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a970c5e-60dd-4766-996a-1f9a8cd70521 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.265638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a970c5e-60dd-4766-996a-1f9a8cd70521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.265906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a970c5e-60dd-4766-996a-1f9a8cd70521 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.266594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a970c5e-60dd-4766-996a-1f9a8cd70521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:47.266897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a970c5e-60dd-4766-996a-1f9a8cd70521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.268785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a970c5e-60dd-4766-996a-1f9a8cd70521 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.280523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1207/2399] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:47.284692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d1fd1-709f-4eb7-ad77-93bcb039e2a0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.293854 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d1fd1-709f-4eb7-ad77-93bcb039e2a0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.298500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd8a2e-39bf-496e-8e0f-4e25acaa276a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.299101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd8a2e-39bf-496e-8e0f-4e25acaa276a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.299382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd8a2e-39bf-496e-8e0f-4e25acaa276a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.299656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd8a2e-39bf-496e-8e0f-4e25acaa276a admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.300377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd8a2e-39bf-496e-8e0f-4e25acaa276a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.302265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd8a2e-39bf-496e-8e0f-4e25acaa276a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.330056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1193/2400] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:47.334013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a970c5e-60dd-4766-996a-1f9a8cd70521 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.344705 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a970c5e-60dd-4766-996a-1f9a8cd70521 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.399412 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020b1d9-2ac1-4164-ae3e-a2b15c7d17e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.400021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020b1d9-2ac1-4164-ae3e-a2b15c7d17e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.400337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020b1d9-2ac1-4164-ae3e-a2b15c7d17e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.400614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020b1d9-2ac1-4164-ae3e-a2b15c7d17e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.401289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020b1d9-2ac1-4164-ae3e-a2b15c7d17e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.403199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020b1d9-2ac1-4164-ae3e-a2b15c7d17e9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.423599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1208/2401] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:47.427808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd8a2e-39bf-496e-8e0f-4e25acaa276a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.438526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd8a2e-39bf-496e-8e0f-4e25acaa276a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.443226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cafbe-0969-49da-a475-71b244ebd32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.444052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cafbe-0969-49da-a475-71b244ebd32f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.444375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cafbe-0969-49da-a475-71b244ebd32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.444657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cafbe-0969-49da-a475-71b244ebd32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.445366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cafbe-0969-49da-a475-71b244ebd32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.447558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cafbe-0969-49da-a475-71b244ebd32f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.457774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1194/2402] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:47.461419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020b1d9-2ac1-4164-ae3e-a2b15c7d17e9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.471223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020b1d9-2ac1-4164-ae3e-a2b15c7d17e9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.475841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79150d6c-6aa1-44f2-a821-74d3e7391475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.476482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79150d6c-6aa1-44f2-a821-74d3e7391475 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.476767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79150d6c-6aa1-44f2-a821-74d3e7391475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.477044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79150d6c-6aa1-44f2-a821-74d3e7391475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.477774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79150d6c-6aa1-44f2-a821-74d3e7391475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.479352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79150d6c-6aa1-44f2-a821-74d3e7391475 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.489642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1209/2403] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:47.494227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cafbe-0969-49da-a475-71b244ebd32f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.503968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cafbe-0969-49da-a475-71b244ebd32f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.508551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508c2a0-f236-4a69-9d26-fb32f5812fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.509752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508c2a0-f236-4a69-9d26-fb32f5812fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.510034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508c2a0-f236-4a69-9d26-fb32f5812fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.510309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508c2a0-f236-4a69-9d26-fb32f5812fc6 admin admin] PATH_INFO: `/v3/projects/8e270add351b434aa6f5c43c7e6897b4/users/c7eddbf29c2d4df084ca842d32eecf3a/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.524680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508c2a0-f236-4a69-9d26-fb32f5812fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e270add351b434aa6f5c43c7e6897b4, user_id=c7eddbf29c2d4df084ca842d32eecf3a, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.527286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508c2a0-f236-4a69-9d26-fb32f5812fc6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.540484 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1195/2404] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:47 2022] PUT /identity/v3/projects/8e270add351b434aa6f5c43c7e6897b4/users/c7eddbf29c2d4df084ca842d32eecf3a/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:47.550764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f50ce-a84a-4a52-a411-53add5843577 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.551054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f50ce-a84a-4a52-a411-53add5843577 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.551333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f50ce-a84a-4a52-a411-53add5843577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.578999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6b2f50ce-a84a-4a52-a411-53add5843577 None None] MFA Rules not processed for user `c7eddbf29c2d4df084ca842d32eecf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:47.580294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6b2f50ce-a84a-4a52-a411-53add5843577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.623477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:47.646521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1210/2405] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:47.651246 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508c2a0-f236-4a69-9d26-fb32f5812fc6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.681653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:47.714449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508c2a0-f236-4a69-9d26-fb32f5812fc6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.719003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644966e-07e3-4b8b-8d61-e822afca8d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.719614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644966e-07e3-4b8b-8d61-e822afca8d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.719903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644966e-07e3-4b8b-8d61-e822afca8d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.720213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644966e-07e3-4b8b-8d61-e822afca8d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.720890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644966e-07e3-4b8b-8d61-e822afca8d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.722784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644966e-07e3-4b8b-8d61-e822afca8d22 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.749826 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1196/2406] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:47.759016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f50ce-a84a-4a52-a411-53add5843577 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.770075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f50ce-a84a-4a52-a411-53add5843577 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.825842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c31d-f840-4495-baf4-c20ff4ebe502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.826463 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c31d-f840-4495-baf4-c20ff4ebe502 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.826745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c31d-f840-4495-baf4-c20ff4ebe502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.827020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938c31d-f840-4495-baf4-c20ff4ebe502 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.827696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938c31d-f840-4495-baf4-c20ff4ebe502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.829666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938c31d-f840-4495-baf4-c20ff4ebe502 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.850130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1211/2407] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:47.854771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644966e-07e3-4b8b-8d61-e822afca8d22 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.865254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644966e-07e3-4b8b-8d61-e822afca8d22 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.870504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8201f-8b0e-4711-9960-88dbc044e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.871105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8201f-8b0e-4711-9960-88dbc044e3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.871393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8201f-8b0e-4711-9960-88dbc044e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.871669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8201f-8b0e-4711-9960-88dbc044e3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.872395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8201f-8b0e-4711-9960-88dbc044e3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.873985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8201f-8b0e-4711-9960-88dbc044e3e6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.884428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1197/2408] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:47.888440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c31d-f840-4495-baf4-c20ff4ebe502 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.898607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938c31d-f840-4495-baf4-c20ff4ebe502 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.903177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a22ae8-c96f-4c83-99e5-a98041a5028a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.903785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a22ae8-c96f-4c83-99e5-a98041a5028a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.904069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a22ae8-c96f-4c83-99e5-a98041a5028a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.904378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a22ae8-c96f-4c83-99e5-a98041a5028a admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.905075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a22ae8-c96f-4c83-99e5-a98041a5028a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.906665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a22ae8-c96f-4c83-99e5-a98041a5028a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.916815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1212/2409] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:47.920687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8201f-8b0e-4711-9960-88dbc044e3e6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.931172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8201f-8b0e-4711-9960-88dbc044e3e6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.935987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4983-8375-42c1-a755-cb11ac73009c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.936718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4983-8375-42c1-a755-cb11ac73009c admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.937000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4983-8375-42c1-a755-cb11ac73009c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.937542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4983-8375-42c1-a755-cb11ac73009c admin admin] PATH_INFO: `/v3/projects/ff0c44ec1ac44f3b8d21d8bec654e0f0/users/60601934e26740f4823d630eee4540cf/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.951870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e4983-8375-42c1-a755-cb11ac73009c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff0c44ec1ac44f3b8d21d8bec654e0f0, user_id=60601934e26740f4823d630eee4540cf, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.954559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439e4983-8375-42c1-a755-cb11ac73009c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.967535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1198/2410] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:47 2022] PUT /identity/v3/projects/ff0c44ec1ac44f3b8d21d8bec654e0f0/users/60601934e26740f4823d630eee4540cf/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:47.978097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a31ee-adec-4ebb-95f7-3200fa07d2bc None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.978383 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a31ee-adec-4ebb-95f7-3200fa07d2bc None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.978655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a31ee-adec-4ebb-95f7-3200fa07d2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.005929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7b8a31ee-adec-4ebb-95f7-3200fa07d2bc None None] MFA Rules not processed for user `60601934e26740f4823d630eee4540cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:48.007133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7b8a31ee-adec-4ebb-95f7-3200fa07d2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:48.070912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1213/2411] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:48.075504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4983-8375-42c1-a755-cb11ac73009c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.142606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4983-8375-42c1-a755-cb11ac73009c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.147685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a054c4-466e-479f-a6fa-8dd824ed51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.148341 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a054c4-466e-479f-a6fa-8dd824ed51b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.148631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a054c4-466e-479f-a6fa-8dd824ed51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.148904 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a054c4-466e-479f-a6fa-8dd824ed51b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.150151 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a054c4-466e-479f-a6fa-8dd824ed51b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.151960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a054c4-466e-479f-a6fa-8dd824ed51b9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.179331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1199/2412] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:48 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:48.183466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a31ee-adec-4ebb-95f7-3200fa07d2bc None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.193999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a31ee-adec-4ebb-95f7-3200fa07d2bc None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.250168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:48.260778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb423-6bc2-4c5d-bdd0-9b2b0a23e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.261409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb423-6bc2-4c5d-bdd0-9b2b0a23e525 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.261689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb423-6bc2-4c5d-bdd0-9b2b0a23e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.261960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eeb423-6bc2-4c5d-bdd0-9b2b0a23e525 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.262812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eeb423-6bc2-4c5d-bdd0-9b2b0a23e525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.264613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eeb423-6bc2-4c5d-bdd0-9b2b0a23e525 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.291627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1214/2413] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:48 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:48.295677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a054c4-466e-479f-a6fa-8dd824ed51b9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.311929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a054c4-466e-479f-a6fa-8dd824ed51b9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.316877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceabfc5-eacf-4fde-8273-ce610967adce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.317573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceabfc5-eacf-4fde-8273-ce610967adce admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.317922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceabfc5-eacf-4fde-8273-ce610967adce admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.318273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceabfc5-eacf-4fde-8273-ce610967adce admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.319076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceabfc5-eacf-4fde-8273-ce610967adce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.320752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceabfc5-eacf-4fde-8273-ce610967adce admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.332546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1200/2414] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:48.336617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb423-6bc2-4c5d-bdd0-9b2b0a23e525 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.351728 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eeb423-6bc2-4c5d-bdd0-9b2b0a23e525 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.359162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94651-2526-4874-8040-ebfeeec6b4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.359917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94651-2526-4874-8040-ebfeeec6b4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.360525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94651-2526-4874-8040-ebfeeec6b4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.360849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb94651-2526-4874-8040-ebfeeec6b4d5 admin admin] PATH_INFO: `/v3/projects/217bd2924ef74da38ad614be4ef89349/users/ab374f00a79240649dbee734fb449bf9/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.377216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb94651-2526-4874-8040-ebfeeec6b4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217bd2924ef74da38ad614be4ef89349, user_id=ab374f00a79240649dbee734fb449bf9, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.379265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb94651-2526-4874-8040-ebfeeec6b4d5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.391952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1215/2415] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:48 2022] PUT /identity/v3/projects/217bd2924ef74da38ad614be4ef89349/users/ab374f00a79240649dbee734fb449bf9/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:48.396116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceabfc5-eacf-4fde-8273-ce610967adce admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.406501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceabfc5-eacf-4fde-8273-ce610967adce admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.454038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:48.464496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f36e9-ac6f-40f8-a183-3cc147adf70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.465107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f36e9-ac6f-40f8-a183-3cc147adf70f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.465414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f36e9-ac6f-40f8-a183-3cc147adf70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.465683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f36e9-ac6f-40f8-a183-3cc147adf70f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.466368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f36e9-ac6f-40f8-a183-3cc147adf70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.467997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f36e9-ac6f-40f8-a183-3cc147adf70f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.477768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1201/2416] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:48.481883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94651-2526-4874-8040-ebfeeec6b4d5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.491998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb94651-2526-4874-8040-ebfeeec6b4d5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.496728 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0bb63-f08b-4dc7-9aef-5035b6a1a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.497395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0bb63-f08b-4dc7-9aef-5035b6a1a179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.497656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0bb63-f08b-4dc7-9aef-5035b6a1a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.497931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0bb63-f08b-4dc7-9aef-5035b6a1a179 admin admin] PATH_INFO: `/v3/projects/217bd2924ef74da38ad614be4ef89349/users/ab374f00a79240649dbee734fb449bf9/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.499832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0bb63-f08b-4dc7-9aef-5035b6a1a179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217bd2924ef74da38ad614be4ef89349, user_id=ab374f00a79240649dbee734fb449bf9, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.502526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0bb63-f08b-4dc7-9aef-5035b6a1a179 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.512982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1216/2417] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:48 2022] PUT /identity/v3/projects/217bd2924ef74da38ad614be4ef89349/users/ab374f00a79240649dbee734fb449bf9/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:48.579629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12426e-2ad3-42cb-89a2-5ad2def0d51f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.579917 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12426e-2ad3-42cb-89a2-5ad2def0d51f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.580242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12426e-2ad3-42cb-89a2-5ad2def0d51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.607855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fb12426e-2ad3-42cb-89a2-5ad2def0d51f None None] MFA Rules not processed for user `ab374f00a79240649dbee734fb449bf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:48.609110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fb12426e-2ad3-42cb-89a2-5ad2def0d51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:48.677518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1202/2418] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:48 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:48.688252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0bb63-f08b-4dc7-9aef-5035b6a1a179 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.689930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a2a0bb63-f08b-4dc7-9aef-5035b6a1a179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:48.746184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0bb63-f08b-4dc7-9aef-5035b6a1a179 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.749752 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6679-2415-4317-8fca-1ac0a12340af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.750382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6679-2415-4317-8fca-1ac0a12340af service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.750641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6679-2415-4317-8fca-1ac0a12340af service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.750911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f6679-2415-4317-8fca-1ac0a12340af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.760235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6679-2415-4317-8fca-1ac0a12340af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.761694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f6679-2415-4317-8fca-1ac0a12340af service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.771714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1217/2419] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:48 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:49.263688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12426e-2ad3-42cb-89a2-5ad2def0d51f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:49.273451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12426e-2ad3-42cb-89a2-5ad2def0d51f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:49.277214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84985a7f-9e4a-4e63-943c-0d44153fe132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:49.277821 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985a7f-9e4a-4e63-943c-0d44153fe132 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:49.278100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985a7f-9e4a-4e63-943c-0d44153fe132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:49.278369 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84985a7f-9e4a-4e63-943c-0d44153fe132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:49.336870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84985a7f-9e4a-4e63-943c-0d44153fe132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:49.338351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84985a7f-9e4a-4e63-943c-0d44153fe132 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:49.347093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1203/2420] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:53.619289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6679-2415-4317-8fca-1ac0a12340af service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:53.620745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0b1f6679-2415-4317-8fca-1ac0a12340af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:53.632239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f6679-2415-4317-8fca-1ac0a12340af service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:53.635950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97b1cc-f5f4-4ba0-ae01-3dfeb676781a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:53.636586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b1cc-f5f4-4ba0-ae01-3dfeb676781a service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:53.636863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b1cc-f5f4-4ba0-ae01-3dfeb676781a service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:53.637132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97b1cc-f5f4-4ba0-ae01-3dfeb676781a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:53.692942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97b1cc-f5f4-4ba0-ae01-3dfeb676781a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:53.694393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97b1cc-f5f4-4ba0-ae01-3dfeb676781a service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:53.704124 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1218/2421] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:56.017118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84985a7f-9e4a-4e63-943c-0d44153fe132 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:56.093419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84985a7f-9e4a-4e63-943c-0d44153fe132 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:56.098662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:56.099535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.099820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.100144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] PATH_INFO: `/v3/users/c7eddbf29c2d4df084ca842d32eecf3a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.101532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7eddbf29c2d4df084ca842d32eecf3a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:56.104113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:56.120468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:56.153753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7eddbf29c2d4df084ca842d32eecf3a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.160615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7eddbf29c2d4df084ca842d32eecf3a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.169659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7eddbf29c2d4df084ca842d32eecf3a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.170357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7eddbf29c2d4df084ca842d32eecf3a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.170978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7eddbf29c2d4df084ca842d32eecf3a'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.189470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1204/2422] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:56 2022] DELETE /identity/v3/users/c7eddbf29c2d4df084ca842d32eecf3a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:56.194018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3df937-70c2-435a-a5ae-d8d31853f648 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.194491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3df937-70c2-435a-a5ae-d8d31853f648 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.194754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3df937-70c2-435a-a5ae-d8d31853f648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.214339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2b3df937-70c2-435a-a5ae-d8d31853f648 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:56.216330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2b3df937-70c2-435a-a5ae-d8d31853f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:56.262453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:56.281443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1219/2423] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:56.292695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:56.294452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:56.357388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdbe51-2953-48cb-9e9e-f84455901ef7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:56.361072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc9a4-23d9-4059-b992-5cb789f606b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:56.361848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc9a4-23d9-4059-b992-5cb789f606b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.362132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc9a4-23d9-4059-b992-5cb789f606b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.362407 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abecc9a4-23d9-4059-b992-5cb789f606b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.372478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc9a4-23d9-4059-b992-5cb789f606b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:56.373935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abecc9a4-23d9-4059-b992-5cb789f606b8 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:56.384376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1205/2424] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:56.674013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3df937-70c2-435a-a5ae-d8d31853f648 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:56.674922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2b3df937-70c2-435a-a5ae-d8d31853f648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:56.687703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3df937-70c2-435a-a5ae-d8d31853f648 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:56.703249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:56.704470 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.704884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.704999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] PATH_INFO: `/v3/projects/8e270add351b434aa6f5c43c7e6897b4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.707795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e270add351b434aa6f5c43c7e6897b4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:56.709983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:56.768878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e270add351b434aa6f5c43c7e6897b4', 'request_id': 'req-31a041c0-3e58-476e-adf9-9b03fdada792'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.777686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e270add351b434aa6f5c43c7e6897b4', 'request_id': 'req-31a041c0-3e58-476e-adf9-9b03fdada792'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.788288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e270add351b434aa6f5c43c7e6897b4', 'request_id': 'req-31a041c0-3e58-476e-adf9-9b03fdada792'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.803651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] The token cache is being invalidate because project 8e270add351b434aa6f5c43c7e6897b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:56.804009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.804777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.808230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1220/2425] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:56 2022] DELETE /identity/v3/projects/8e270add351b434aa6f5c43c7e6897b4 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:56.810678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc9a4-23d9-4059-b992-5cb789f606b8 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:56.821685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abecc9a4-23d9-4059-b992-5cb789f606b8 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:56.900374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:56.900374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.900374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.900374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] PATH_INFO: `/v3/users/60601934e26740f4823d630eee4540cf` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.900707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60601934e26740f4823d630eee4540cf)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:56.902857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:56.944825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:56.958273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60601934e26740f4823d630eee4540cf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.969962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60601934e26740f4823d630eee4540cf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.979086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60601934e26740f4823d630eee4540cf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.979923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60601934e26740f4823d630eee4540cf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.980553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60601934e26740f4823d630eee4540cf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.998002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1206/2426] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:56 2022] DELETE /identity/v3/users/60601934e26740f4823d630eee4540cf => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:57.283803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:57.289881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:57.311116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a041c0-3e58-476e-adf9-9b03fdada792 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:57.372568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:57.373294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.373578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.373854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] PATH_INFO: `/v3/projects/ff0c44ec1ac44f3b8d21d8bec654e0f0` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.375556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff0c44ec1ac44f3b8d21d8bec654e0f0)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:57.378956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.427868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff0c44ec1ac44f3b8d21d8bec654e0f0', 'request_id': 'req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.435038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff0c44ec1ac44f3b8d21d8bec654e0f0', 'request_id': 'req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.443738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff0c44ec1ac44f3b8d21d8bec654e0f0', 'request_id': 'req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.452383 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:57.456420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] The token cache is being invalidate because project ff0c44ec1ac44f3b8d21d8bec654e0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:57.457032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.457695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.459304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1221/2427] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:57 2022] DELETE /identity/v3/projects/ff0c44ec1ac44f3b8d21d8bec654e0f0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:57.463969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:57.465752 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:57.480635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc9c68-35fb-4915-9e18-87d1afd43fe6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:57.537794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:57.538443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.538725 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.539001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] PATH_INFO: `/v3/users/ab374f00a79240649dbee734fb449bf9` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.540722 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab374f00a79240649dbee734fb449bf9)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:57.542655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.594026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab374f00a79240649dbee734fb449bf9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.602694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab374f00a79240649dbee734fb449bf9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.611914 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab374f00a79240649dbee734fb449bf9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.612638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab374f00a79240649dbee734fb449bf9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.613540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a9a94ad9-54bc-4bbe-b47e-40bc34991ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab374f00a79240649dbee734fb449bf9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.635516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1207/2428] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:57 2022] DELETE /identity/v3/users/ab374f00a79240649dbee734fb449bf9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:58.046476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.047989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:58.076901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0674de-1ab4-473d-bb95-8cdd2b812d5c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.147419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.148207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.148477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.149291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] PATH_INFO: `/v3/projects/217bd2924ef74da38ad614be4ef89349` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.150611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217bd2924ef74da38ad614be4ef89349)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.152622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.216462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217bd2924ef74da38ad614be4ef89349', 'request_id': 'req-040e7284-99ac-4e1a-8198-035ac8796975'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:58.225273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217bd2924ef74da38ad614be4ef89349', 'request_id': 'req-040e7284-99ac-4e1a-8198-035ac8796975'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:58.236443 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217bd2924ef74da38ad614be4ef89349', 'request_id': 'req-040e7284-99ac-4e1a-8198-035ac8796975'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:58.276275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] The token cache is being invalidate because project 217bd2924ef74da38ad614be4ef89349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:58.276578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:58.277238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-040e7284-99ac-4e1a-8198-035ac8796975 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:58.280644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1222/2429] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:58 2022] DELETE /identity/v3/projects/217bd2924ef74da38ad614be4ef89349 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:58.286535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32f9fb-d3e3-48db-b290-b6b84e2608b4 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.286824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32f9fb-d3e3-48db-b290-b6b84e2608b4 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.287102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32f9fb-d3e3-48db-b290-b6b84e2608b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.347580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:58.402110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5c32f9fb-d3e3-48db-b290-b6b84e2608b4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:58.403371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5c32f9fb-d3e3-48db-b290-b6b84e2608b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:58.601850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1208/2430] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:58.610333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6785f4-0057-4252-818e-0e66ea8b4dd2 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.610822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6785f4-0057-4252-818e-0e66ea8b4dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.610970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6785f4-0057-4252-818e-0e66ea8b4dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.635809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9f6785f4-0057-4252-818e-0e66ea8b4dd2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:58.637100 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9f6785f4-0057-4252-818e-0e66ea8b4dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:58.645464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1223/2431] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:58.650201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32f9fb-d3e3-48db-b290-b6b84e2608b4 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.661804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32f9fb-d3e3-48db-b290-b6b84e2608b4 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.667410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cc087-9270-4fcb-9258-72b15aa1f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.668642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cc087-9270-4fcb-9258-72b15aa1f9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.669140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cc087-9270-4fcb-9258-72b15aa1f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.669606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cc087-9270-4fcb-9258-72b15aa1f9b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.670989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cc087-9270-4fcb-9258-72b15aa1f9b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:58.671496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cc087-9270-4fcb-9258-72b15aa1f9b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.674147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cc087-9270-4fcb-9258-72b15aa1f9b4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.690798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1209/2432] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:58.691982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6785f4-0057-4252-818e-0e66ea8b4dd2 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.702316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6785f4-0057-4252-818e-0e66ea8b4dd2 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.707121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ab7ad-b622-47ff-a173-8a76cfb50581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.707738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ab7ad-b622-47ff-a173-8a76cfb50581 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.708021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ab7ad-b622-47ff-a173-8a76cfb50581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.708331 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ab7ad-b622-47ff-a173-8a76cfb50581 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.709013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ab7ad-b622-47ff-a173-8a76cfb50581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.710942 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ab7ad-b622-47ff-a173-8a76cfb50581 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.750572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1224/2433] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:58 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:58.751919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cc087-9270-4fcb-9258-72b15aa1f9b4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.763656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cc087-9270-4fcb-9258-72b15aa1f9b4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.837188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2666700-8e92-4e7a-9135-eae0606c5f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.837824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2666700-8e92-4e7a-9135-eae0606c5f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.838108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2666700-8e92-4e7a-9135-eae0606c5f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.838387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2666700-8e92-4e7a-9135-eae0606c5f5e admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.839079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2666700-8e92-4e7a-9135-eae0606c5f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.841050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2666700-8e92-4e7a-9135-eae0606c5f5e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.871114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1210/2434] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:58 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:58.872264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ab7ad-b622-47ff-a173-8a76cfb50581 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.882895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ab7ad-b622-47ff-a173-8a76cfb50581 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.891776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f743f9-e88a-4020-9ff2-e1e3f46fec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.892830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f743f9-e88a-4020-9ff2-e1e3f46fec2e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.893169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f743f9-e88a-4020-9ff2-e1e3f46fec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.893521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f743f9-e88a-4020-9ff2-e1e3f46fec2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.894291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f743f9-e88a-4020-9ff2-e1e3f46fec2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.896014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f743f9-e88a-4020-9ff2-e1e3f46fec2e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.911968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2666700-8e92-4e7a-9135-eae0606c5f5e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.916277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1225/2435] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:58.923267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2666700-8e92-4e7a-9135-eae0606c5f5e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.930689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09538ce-3a2e-4ef9-a7a4-7bdfd63d3d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.931644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09538ce-3a2e-4ef9-a7a4-7bdfd63d3d8e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.932174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09538ce-3a2e-4ef9-a7a4-7bdfd63d3d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.932760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09538ce-3a2e-4ef9-a7a4-7bdfd63d3d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.933883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09538ce-3a2e-4ef9-a7a4-7bdfd63d3d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.936601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09538ce-3a2e-4ef9-a7a4-7bdfd63d3d8e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.949103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1211/2436] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:58.953314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f743f9-e88a-4020-9ff2-e1e3f46fec2e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.964406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f743f9-e88a-4020-9ff2-e1e3f46fec2e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.970507 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d80c3-91a8-4623-a0d5-fc158e861014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.970957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d80c3-91a8-4623-a0d5-fc158e861014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.971241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d80c3-91a8-4623-a0d5-fc158e861014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.971519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d80c3-91a8-4623-a0d5-fc158e861014 admin admin] PATH_INFO: `/v3/projects/d684e7d755a546108971daff44eb15f1/users/7e23a83f799e458aa2c3724c5c9bd16c/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.988754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d80c3-91a8-4623-a0d5-fc158e861014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d684e7d755a546108971daff44eb15f1, user_id=7e23a83f799e458aa2c3724c5c9bd16c, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.991703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d80c3-91a8-4623-a0d5-fc158e861014 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:59.007707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1226/2437] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:58 2022] PUT /identity/v3/projects/d684e7d755a546108971daff44eb15f1/users/7e23a83f799e458aa2c3724c5c9bd16c/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:59.021283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1699ce-b0b1-4502-b894-6547b2fef3db None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:59.021577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1699ce-b0b1-4502-b894-6547b2fef3db None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:59.021841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1699ce-b0b1-4502-b894-6547b2fef3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:59.053620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5e1699ce-b0b1-4502-b894-6547b2fef3db None None] MFA Rules not processed for user `7e23a83f799e458aa2c3724c5c9bd16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:59.054796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5e1699ce-b0b1-4502-b894-6547b2fef3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:59.061031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:59.128362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1212/2438] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:59.133494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d80c3-91a8-4623-a0d5-fc158e861014 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:59.152372 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:59.209374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d80c3-91a8-4623-a0d5-fc158e861014 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:59.214141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61356d26-26d0-45b9-b5c7-ed683f8995f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:59.214770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61356d26-26d0-45b9-b5c7-ed683f8995f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:59.215052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61356d26-26d0-45b9-b5c7-ed683f8995f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:59.215328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61356d26-26d0-45b9-b5c7-ed683f8995f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:59.216475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61356d26-26d0-45b9-b5c7-ed683f8995f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:59.218349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61356d26-26d0-45b9-b5c7-ed683f8995f0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:59.250163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1227/2439] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:59 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:59.253967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1699ce-b0b1-4502-b894-6547b2fef3db None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:59.266074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1699ce-b0b1-4502-b894-6547b2fef3db None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:59.348052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ac35b-9976-4e27-961e-de8425fb8a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:59.348052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ac35b-9976-4e27-961e-de8425fb8a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:59.348052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ac35b-9976-4e27-961e-de8425fb8a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:59.348052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ac35b-9976-4e27-961e-de8425fb8a9c admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:59.348645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ac35b-9976-4e27-961e-de8425fb8a9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:59.349081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ac35b-9976-4e27-961e-de8425fb8a9c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:59.380953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1213/2440] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:59 2022] POST /identity/v3/users => generated 303 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:59.382274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61356d26-26d0-45b9-b5c7-ed683f8995f0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:59.394914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61356d26-26d0-45b9-b5c7-ed683f8995f0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:59.400169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd89d87-500c-41b5-879e-6499b729a086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:59.400714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd89d87-500c-41b5-879e-6499b729a086 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:59.400997 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd89d87-500c-41b5-879e-6499b729a086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:59.401379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd89d87-500c-41b5-879e-6499b729a086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:59.402154 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd89d87-500c-41b5-879e-6499b729a086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:59.403834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd89d87-500c-41b5-879e-6499b729a086 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:59.415243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1228/2441] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:59.419271 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ac35b-9976-4e27-961e-de8425fb8a9c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:59.433623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ac35b-9976-4e27-961e-de8425fb8a9c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:59.439016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1e535-6188-46ff-94ef-dd2be69af367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:59.439913 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1e535-6188-46ff-94ef-dd2be69af367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:59.440295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1e535-6188-46ff-94ef-dd2be69af367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:59.440642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1e535-6188-46ff-94ef-dd2be69af367 admin admin] PATH_INFO: `/v3/projects/4a622d1540b9401784eebc2e4f19d3bd/users/abe55b968ecf4aec9aa3c011e5e3f4a1/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:59.457973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1e535-6188-46ff-94ef-dd2be69af367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a622d1540b9401784eebc2e4f19d3bd, user_id=abe55b968ecf4aec9aa3c011e5e3f4a1, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:59.460791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1e535-6188-46ff-94ef-dd2be69af367 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:59.476280 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1214/2442] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:59 2022] PUT /identity/v3/projects/4a622d1540b9401784eebc2e4f19d3bd/users/abe55b968ecf4aec9aa3c011e5e3f4a1/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:59.480456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd89d87-500c-41b5-879e-6499b729a086 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:59.491713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd89d87-500c-41b5-879e-6499b729a086 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:59.559826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0599f1-6386-4b26-931a-4b515f3f32d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:59.560479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0599f1-6386-4b26-931a-4b515f3f32d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:59.560761 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0599f1-6386-4b26-931a-4b515f3f32d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:59.561033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0599f1-6386-4b26-931a-4b515f3f32d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:59.561889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0599f1-6386-4b26-931a-4b515f3f32d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:59.563479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0599f1-6386-4b26-931a-4b515f3f32d5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:59.577092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1229/2443] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:59.579628 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1e535-6188-46ff-94ef-dd2be69af367 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:59.597172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1e535-6188-46ff-94ef-dd2be69af367 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:59.611469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e3568-c798-484a-9d7d-7014727cf217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:59.612183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e3568-c798-484a-9d7d-7014727cf217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:59.612469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e3568-c798-484a-9d7d-7014727cf217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:59.612747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e3568-c798-484a-9d7d-7014727cf217 admin admin] PATH_INFO: `/v3/projects/4a622d1540b9401784eebc2e4f19d3bd/users/abe55b968ecf4aec9aa3c011e5e3f4a1/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:59.619584 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e3568-c798-484a-9d7d-7014727cf217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a622d1540b9401784eebc2e4f19d3bd, user_id=abe55b968ecf4aec9aa3c011e5e3f4a1, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:59.621852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e3568-c798-484a-9d7d-7014727cf217 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:59.640456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1215/2444] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:59 2022] PUT /identity/v3/projects/4a622d1540b9401784eebc2e4f19d3bd/users/abe55b968ecf4aec9aa3c011e5e3f4a1/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:59.651046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b655c-4963-46a5-bd8f-97254b338306 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:59.651590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b655c-4963-46a5-bd8f-97254b338306 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:59.651884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b655c-4963-46a5-bd8f-97254b338306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:59.684615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a70b655c-4963-46a5-bd8f-97254b338306 None None] MFA Rules not processed for user `abe55b968ecf4aec9aa3c011e5e3f4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:59.685857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a70b655c-4963-46a5-bd8f-97254b338306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:59.783666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1230/2445] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:47:59 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:59.800756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e3568-c798-484a-9d7d-7014727cf217 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:59.802605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b06e3568-c798-484a-9d7d-7014727cf217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:59.904855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:59.918975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e3568-c798-484a-9d7d-7014727cf217 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:59.923727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ea8be-a400-481a-93e1-818a5eb5ddd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:59.924507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ea8be-a400-481a-93e1-818a5eb5ddd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:59.924855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ea8be-a400-481a-93e1-818a5eb5ddd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:59.925203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ea8be-a400-481a-93e1-818a5eb5ddd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:59.942372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ea8be-a400-481a-93e1-818a5eb5ddd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:59.943808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ea8be-a400-481a-93e1-818a5eb5ddd1 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:59.953990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1216/2446] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:59 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:00.037221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b655c-4963-46a5-bd8f-97254b338306 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:00.038649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a70b655c-4963-46a5-bd8f-97254b338306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:00.058082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b655c-4963-46a5-bd8f-97254b338306 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:00.062510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdc598-3a9f-41d2-b363-30638dcf806d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:00.063147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdc598-3a9f-41d2-b363-30638dcf806d service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:00.063434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdc598-3a9f-41d2-b363-30638dcf806d service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:00.063711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdc598-3a9f-41d2-b363-30638dcf806d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:00.083960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:00.156346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdc598-3a9f-41d2-b363-30638dcf806d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:00.157815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdc598-3a9f-41d2-b363-30638dcf806d service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:00.167371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1231/2447] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:01.948455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1f818-e594-44b6-aff8-9a2838ede022 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:01.948907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1f818-e594-44b6-aff8-9a2838ede022 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:01.949003 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1f818-e594-44b6-aff8-9a2838ede022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:01.968641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-73e1f818-e594-44b6-aff8-9a2838ede022 None None] MFA Rules not processed for user `3d13a56d271447bb936cea12e693b22f`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:01.969845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-73e1f818-e594-44b6-aff8-9a2838ede022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:02.032930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1217/2448] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:48:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:03.521049 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdc598-3a9f-41d2-b363-30638dcf806d service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:03.593868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdc598-3a9f-41d2-b363-30638dcf806d service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:03.598439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:03.599076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.599361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.599640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] PATH_INFO: `/v3/users/7e23a83f799e458aa2c3724c5c9bd16c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.600991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e23a83f799e458aa2c3724c5c9bd16c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:03.603791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:03.651070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e23a83f799e458aa2c3724c5c9bd16c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.662584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e23a83f799e458aa2c3724c5c9bd16c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.669778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e23a83f799e458aa2c3724c5c9bd16c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.670435 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e23a83f799e458aa2c3724c5c9bd16c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.671035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e23a83f799e458aa2c3724c5c9bd16c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.684428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1232/2449] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:03 2022] DELETE /identity/v3/users/7e23a83f799e458aa2c3724c5c9bd16c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:03.688940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef4dfa-4072-4e7a-8920-854842943931 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.689430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef4dfa-4072-4e7a-8920-854842943931 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.689528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef4dfa-4072-4e7a-8920-854842943931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.707680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6fef4dfa-4072-4e7a-8920-854842943931 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:03.709048 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6fef4dfa-4072-4e7a-8920-854842943931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:03.771305 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1218/2450] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:03.805445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:03.807180 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:03.841625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:03.871434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861a4d53-9173-4b7c-acb2-0e2b8c2c06c2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:03.875135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485a2d8-9690-4c98-b792-3badc61f4b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:03.875766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485a2d8-9690-4c98-b792-3badc61f4b87 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.876069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485a2d8-9690-4c98-b792-3badc61f4b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.876350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485a2d8-9690-4c98-b792-3badc61f4b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.886103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485a2d8-9690-4c98-b792-3badc61f4b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:03.887644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485a2d8-9690-4c98-b792-3badc61f4b87 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:03.899760 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1233/2451] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:04.310215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef4dfa-4072-4e7a-8920-854842943931 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:04.312000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6fef4dfa-4072-4e7a-8920-854842943931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:04.324550 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef4dfa-4072-4e7a-8920-854842943931 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:04.333635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:04.334870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.335397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.335816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] PATH_INFO: `/v3/projects/d684e7d755a546108971daff44eb15f1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.337181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d684e7d755a546108971daff44eb15f1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:04.339090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:04.396645 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd684e7d755a546108971daff44eb15f1', 'request_id': 'req-75c56fa1-ce56-451f-832e-07f0c42d2cdc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.404484 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd684e7d755a546108971daff44eb15f1', 'request_id': 'req-75c56fa1-ce56-451f-832e-07f0c42d2cdc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.413181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd684e7d755a546108971daff44eb15f1', 'request_id': 'req-75c56fa1-ce56-451f-832e-07f0c42d2cdc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.424948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] The token cache is being invalidate because project d684e7d755a546108971daff44eb15f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:04.425248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.426031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.427855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1219/2452] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:04 2022] DELETE /identity/v3/projects/d684e7d755a546108971daff44eb15f1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:04.432377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485a2d8-9690-4c98-b792-3badc61f4b87 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:04.442577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485a2d8-9690-4c98-b792-3badc61f4b87 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:04.508550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:04.509695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.510000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.510274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] PATH_INFO: `/v3/users/abe55b968ecf4aec9aa3c011e5e3f4a1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.512064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abe55b968ecf4aec9aa3c011e5e3f4a1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:04.514178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:04.576185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abe55b968ecf4aec9aa3c011e5e3f4a1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.590678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abe55b968ecf4aec9aa3c011e5e3f4a1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.598344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abe55b968ecf4aec9aa3c011e5e3f4a1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.600171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abe55b968ecf4aec9aa3c011e5e3f4a1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.600786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-fa80ff4b-2501-487f-8e59-6e2aaf1d47d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abe55b968ecf4aec9aa3c011e5e3f4a1'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.616105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1234/2453] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:04 2022] DELETE /identity/v3/users/abe55b968ecf4aec9aa3c011e5e3f4a1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:48:05.178615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.180673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:05.193564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c56fa1-ce56-451f-832e-07f0c42d2cdc admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.206527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:05.261337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.261986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.262265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.262538 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] PATH_INFO: `/v3/projects/4a622d1540b9401784eebc2e4f19d3bd` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.263749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a622d1540b9401784eebc2e4f19d3bd)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.265695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.315658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a622d1540b9401784eebc2e4f19d3bd', 'request_id': 'req-e02af33c-2ee1-4824-8170-f0ffc4535f7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.322905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a622d1540b9401784eebc2e4f19d3bd', 'request_id': 'req-e02af33c-2ee1-4824-8170-f0ffc4535f7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.329561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a622d1540b9401784eebc2e4f19d3bd', 'request_id': 'req-e02af33c-2ee1-4824-8170-f0ffc4535f7b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.341012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] The token cache is being invalidate because project 4a622d1540b9401784eebc2e4f19d3bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:05.341233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.341915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e02af33c-2ee1-4824-8170-f0ffc4535f7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.343483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1220/2454] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:05 2022] DELETE /identity/v3/projects/4a622d1540b9401784eebc2e4f19d3bd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:05.349269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fcdf1-7b92-473f-b82d-f57c13e82bb4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.349726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fcdf1-7b92-473f-b82d-f57c13e82bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.350066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fcdf1-7b92-473f-b82d-f57c13e82bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.370758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1c8fcdf1-7b92-473f-b82d-f57c13e82bb4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:05.372070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1c8fcdf1-7b92-473f-b82d-f57c13e82bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:05.418380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:05.434791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1235/2455] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:48:05.443643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbaa462-a761-493d-94db-8346f0199220 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.443973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbaa462-a761-493d-94db-8346f0199220 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.444303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbaa462-a761-493d-94db-8346f0199220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.465292 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-dcbaa462-a761-493d-94db-8346f0199220 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:05.466558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dcbaa462-a761-493d-94db-8346f0199220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:05.475674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1221/2456] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:05.480765 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fcdf1-7b92-473f-b82d-f57c13e82bb4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.490843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fcdf1-7b92-473f-b82d-f57c13e82bb4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.495665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b2aef-fd4b-4092-985a-f0e29d8cd4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.496308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2aef-fd4b-4092-985a-f0e29d8cd4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.496588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2aef-fd4b-4092-985a-f0e29d8cd4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.496856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2aef-fd4b-4092-985a-f0e29d8cd4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.497549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b2aef-fd4b-4092-985a-f0e29d8cd4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:48:05.497851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b2aef-fd4b-4092-985a-f0e29d8cd4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.499434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b2aef-fd4b-4092-985a-f0e29d8cd4b1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.511411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1236/2457] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:48:05.521331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbaa462-a761-493d-94db-8346f0199220 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.531513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbaa462-a761-493d-94db-8346f0199220 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.536189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16cd07-54b5-4778-b260-9696d0bc8896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.536799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16cd07-54b5-4778-b260-9696d0bc8896 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.537080 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16cd07-54b5-4778-b260-9696d0bc8896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.537353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16cd07-54b5-4778-b260-9696d0bc8896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.538017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16cd07-54b5-4778-b260-9696d0bc8896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.540553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b16cd07-54b5-4778-b260-9696d0bc8896 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.571430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1222/2458] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:05.573768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b2aef-fd4b-4092-985a-f0e29d8cd4b1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.586543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b2aef-fd4b-4092-985a-f0e29d8cd4b1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.656016 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a187ad-2518-4667-b35c-e2f8dce3a391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.656693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a187ad-2518-4667-b35c-e2f8dce3a391 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.656976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a187ad-2518-4667-b35c-e2f8dce3a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.657529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a187ad-2518-4667-b35c-e2f8dce3a391 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.658350 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a187ad-2518-4667-b35c-e2f8dce3a391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.660325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a187ad-2518-4667-b35c-e2f8dce3a391 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.696915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1237/2459] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:05.701213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16cd07-54b5-4778-b260-9696d0bc8896 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.729578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16cd07-54b5-4778-b260-9696d0bc8896 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.734717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ca9b5-9414-4767-853c-2bac95d87a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.735368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ca9b5-9414-4767-853c-2bac95d87a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.735652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ca9b5-9414-4767-853c-2bac95d87a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.735929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18ca9b5-9414-4767-853c-2bac95d87a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.737130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ca9b5-9414-4767-853c-2bac95d87a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.739618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18ca9b5-9414-4767-853c-2bac95d87a07 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.751023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1223/2460] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:48:05.755084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a187ad-2518-4667-b35c-e2f8dce3a391 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.768599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a187ad-2518-4667-b35c-e2f8dce3a391 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.773989 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc032367-6801-4bda-9af2-9a578cc66afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.774609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc032367-6801-4bda-9af2-9a578cc66afe admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.775895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc032367-6801-4bda-9af2-9a578cc66afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.776196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc032367-6801-4bda-9af2-9a578cc66afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.776931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc032367-6801-4bda-9af2-9a578cc66afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.778649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc032367-6801-4bda-9af2-9a578cc66afe admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.792555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1238/2461] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:05.793726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ca9b5-9414-4767-853c-2bac95d87a07 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.803974 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18ca9b5-9414-4767-853c-2bac95d87a07 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.808777 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8873b-ba29-46d4-8166-718495c6da37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.809457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8873b-ba29-46d4-8166-718495c6da37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.809741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8873b-ba29-46d4-8166-718495c6da37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.810019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe8873b-ba29-46d4-8166-718495c6da37 admin admin] PATH_INFO: `/v3/projects/6eec4d5d31cc4262b6d16b84770ed775/users/d033083889044e218d7acbca3ad1bf27/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.826116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8873b-ba29-46d4-8166-718495c6da37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eec4d5d31cc4262b6d16b84770ed775, user_id=d033083889044e218d7acbca3ad1bf27, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.828954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe8873b-ba29-46d4-8166-718495c6da37 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.843416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1224/2462] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:48:05 2022] PUT /identity/v3/projects/6eec4d5d31cc4262b6d16b84770ed775/users/d033083889044e218d7acbca3ad1bf27/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:48:05.855084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04c93-7482-4d29-b839-eab977bf636e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.855407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04c93-7482-4d29-b839-eab977bf636e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.855687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04c93-7482-4d29-b839-eab977bf636e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.884513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-93c04c93-7482-4d29-b839-eab977bf636e None None] MFA Rules not processed for user `d033083889044e218d7acbca3ad1bf27`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:05.885747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93c04c93-7482-4d29-b839-eab977bf636e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:05.957880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1239/2463] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:05.969378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8873b-ba29-46d4-8166-718495c6da37 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.971959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bbe8873b-ba29-46d4-8166-718495c6da37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:06.027012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:06.042983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe8873b-ba29-46d4-8166-718495c6da37 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:06.046702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e2b6e-8652-4c99-9318-2af101850cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:06.047324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e2b6e-8652-4c99-9318-2af101850cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:06.047606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e2b6e-8652-4c99-9318-2af101850cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:06.047889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e2b6e-8652-4c99-9318-2af101850cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:06.058092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e2b6e-8652-4c99-9318-2af101850cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:06.059631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e2b6e-8652-4c99-9318-2af101850cb2 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:06.072329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1225/2464] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:15.655199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c04c93-7482-4d29-b839-eab977bf636e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:15.710661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:15.730185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c04c93-7482-4d29-b839-eab977bf636e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:15.734925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:15.735578 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:15.735857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:15.736152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] PATH_INFO: `/v3/users/d033083889044e218d7acbca3ad1bf27` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:15.737657 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d033083889044e218d7acbca3ad1bf27)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:15.739594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:15.789586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd033083889044e218d7acbca3ad1bf27'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:15.805567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd033083889044e218d7acbca3ad1bf27'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:15.813416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd033083889044e218d7acbca3ad1bf27'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:15.814142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd033083889044e218d7acbca3ad1bf27'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:15.814800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd033083889044e218d7acbca3ad1bf27'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:15.829033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1240/2465] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:15 2022] DELETE /identity/v3/users/d033083889044e218d7acbca3ad1bf27 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:15.833455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302818-ce82-418d-8d35-c4f34e7285fd None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:15.834033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302818-ce82-418d-8d35-c4f34e7285fd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:15.834033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e302818-ce82-418d-8d35-c4f34e7285fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:15.854403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5e302818-ce82-418d-8d35-c4f34e7285fd None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:15.855561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5e302818-ce82-418d-8d35-c4f34e7285fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:15.912795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1226/2466] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:15.923083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:15.924523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:15.981378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f0284-d5a8-45eb-bc7a-6aa3d08a0722 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:15.985017 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a408934-aa3b-443c-8964-55fb4a52f2ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:15.985628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408934-aa3b-443c-8964-55fb4a52f2ec service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:15.985913 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408934-aa3b-443c-8964-55fb4a52f2ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:15.986189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408934-aa3b-443c-8964-55fb4a52f2ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:15.995094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a408934-aa3b-443c-8964-55fb4a52f2ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:15.996568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a408934-aa3b-443c-8964-55fb4a52f2ec service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:16.005813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1241/2467] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:16.284866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e302818-ce82-418d-8d35-c4f34e7285fd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:16.287200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5e302818-ce82-418d-8d35-c4f34e7285fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:16.301381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e302818-ce82-418d-8d35-c4f34e7285fd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:16.306023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:16.306669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:16.306948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:16.307239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] PATH_INFO: `/v3/projects/6eec4d5d31cc4262b6d16b84770ed775` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:16.309020 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eec4d5d31cc4262b6d16b84770ed775)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:16.310427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:16.357979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eec4d5d31cc4262b6d16b84770ed775', 'request_id': 'req-e95fe004-4d4c-4866-af74-33fff8f1e610'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:16.364556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eec4d5d31cc4262b6d16b84770ed775', 'request_id': 'req-e95fe004-4d4c-4866-af74-33fff8f1e610'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:16.370836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eec4d5d31cc4262b6d16b84770ed775', 'request_id': 'req-e95fe004-4d4c-4866-af74-33fff8f1e610'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:16.381199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] The token cache is being invalidate because project 6eec4d5d31cc4262b6d16b84770ed775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:16.381482 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:16.382668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e95fe004-4d4c-4866-af74-33fff8f1e610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:16.384269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1227/2468] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:16 2022] DELETE /identity/v3/projects/6eec4d5d31cc4262b6d16b84770ed775 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:26.001724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=58,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:26.378286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:36.667190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89848-8f46-4ff1-85ac-998dc241299d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:36.667675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89848-8f46-4ff1-85ac-998dc241299d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:36.667772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca89848-8f46-4ff1-85ac-998dc241299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:36.687505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0ca89848-8f46-4ff1-85ac-998dc241299d None None] MFA Rules not processed for user `e477f5953a534355b29c071086846ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:36.688723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0ca89848-8f46-4ff1-85ac-998dc241299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:36.744356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1242/2469] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:48:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:46.737451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=25 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:03.113131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9720f-7680-4aca-b892-d9e98f62cc90 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:03.113600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9720f-7680-4aca-b892-d9e98f62cc90 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:03.113699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9720f-7680-4aca-b892-d9e98f62cc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:03.143144 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-39a9720f-7680-4aca-b892-d9e98f62cc90 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:03.144357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-39a9720f-7680-4aca-b892-d9e98f62cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:03.203356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1228/2470] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:49:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:03.250415 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89848-8f46-4ff1-85ac-998dc241299d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:03.251841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0ca89848-8f46-4ff1-85ac-998dc241299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:03.333508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca89848-8f46-4ff1-85ac-998dc241299d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:03.339678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122d88-87d6-4018-a684-9d86032011b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:03.341004 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122d88-87d6-4018-a684-9d86032011b9 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:03.341345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122d88-87d6-4018-a684-9d86032011b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:03.341625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122d88-87d6-4018-a684-9d86032011b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:03.352170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122d88-87d6-4018-a684-9d86032011b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:03.353721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122d88-87d6-4018-a684-9d86032011b9 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:03.363333 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1243/2471] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:49:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:49:13.196887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=32 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:13.359661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=32 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:17.360769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9720f-7680-4aca-b892-d9e98f62cc90 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:17.362164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-39a9720f-7680-4aca-b892-d9e98f62cc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:17.437389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122d88-87d6-4018-a684-9d86032011b9 service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:17.438854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ca122d88-87d6-4018-a684-9d86032011b9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:17.458409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9720f-7680-4aca-b892-d9e98f62cc90 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:17.462918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122d88-87d6-4018-a684-9d86032011b9 service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:17.463537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9fad8-e434-4b96-9fd7-36f07c7669fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:17.464177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9fad8-e434-4b96-9fd7-36f07c7669fa service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:17.464548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9fad8-e434-4b96-9fd7-36f07c7669fa service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:17.464832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9fad8-e434-4b96-9fd7-36f07c7669fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:17.467121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-85b9fad8-e434-4b96-9fd7-36f07c7669fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:17.468688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46938d7-eeee-4777-ac53-b7ee1bd1f39d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:17.469294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46938d7-eeee-4777-ac53-b7ee1bd1f39d service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:17.469570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46938d7-eeee-4777-ac53-b7ee1bd1f39d service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:17.469839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46938d7-eeee-4777-ac53-b7ee1bd1f39d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:17.471543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f46938d7-eeee-4777-ac53-b7ee1bd1f39d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:17.478453 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9fad8-e434-4b96-9fd7-36f07c7669fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:17.480022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9fad8-e434-4b96-9fd7-36f07c7669fa service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:17.483438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46938d7-eeee-4777-ac53-b7ee1bd1f39d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:17.485090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46938d7-eeee-4777-ac53-b7ee1bd1f39d service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:17.490493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1229/2472] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:17.494927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1244/2473] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:19.417963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42b19d-cd4d-4360-96ee-7df44ec65728 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:19.418528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42b19d-cd4d-4360-96ee-7df44ec65728 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:19.418528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42b19d-cd4d-4360-96ee-7df44ec65728 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:19.420384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1230/2474] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:49:19.426408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737520-f101-4d72-9715-8212895fe007 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:19.426878 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737520-f101-4d72-9715-8212895fe007 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:19.426975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72737520-f101-4d72-9715-8212895fe007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:19.460478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-72737520-f101-4d72-9715-8212895fe007 None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:19.461624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-72737520-f101-4d72-9715-8212895fe007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:19.539617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1245/2475] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:49:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:19.551175 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42b19d-cd4d-4360-96ee-7df44ec65728 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:19.552956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6a42b19d-cd4d-4360-96ee-7df44ec65728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:19.610151 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42b19d-cd4d-4360-96ee-7df44ec65728 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:19.613996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21d44a-876d-40d9-9236-195a1d99ca5d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cd62eb975492aab4a136c0e9825a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:19.614604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21d44a-876d-40d9-9236-195a1d99ca5d service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:19.614886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21d44a-876d-40d9-9236-195a1d99ca5d service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:19.615170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21d44a-876d-40d9-9236-195a1d99ca5d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:19.625567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21d44a-876d-40d9-9236-195a1d99ca5d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:19.627047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21d44a-876d-40d9-9236-195a1d99ca5d service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:19.639007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1231/2476] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:49:19.706923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4123-f63e-4152-b105-ffded1e1ae54 None None] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:19.707390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4123-f63e-4152-b105-ffded1e1ae54 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:19.707759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f4123-f63e-4152-b105-ffded1e1ae54 None None] PATH_INFO: `/` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:19.709430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1246/2477] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:49:19.714647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640f69-85fc-4a75-91de-b1a450e2fb1f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:19.714875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640f69-85fc-4a75-91de-b1a450e2fb1f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:19.715170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0640f69-85fc-4a75-91de-b1a450e2fb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:19.745663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c0640f69-85fc-4a75-91de-b1a450e2fb1f None None] MFA Rules not processed for user `24644cede7e149a6b3e5bd39b930017b`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:19.747377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c0640f69-85fc-4a75-91de-b1a450e2fb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:19.808822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1232/2478] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:49:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:19.821306 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f4123-f63e-4152-b105-ffded1e1ae54 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:19.822975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-276f4123-f63e-4152-b105-ffded1e1ae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:19.836457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f4123-f63e-4152-b105-ffded1e1ae54 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:19.839968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c6945-b1ad-4d98-a7ec-03ed91daa8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:19.840602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c6945-b1ad-4d98-a7ec-03ed91daa8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:19.840884 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c6945-b1ad-4d98-a7ec-03ed91daa8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:19.841156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c6945-b1ad-4d98-a7ec-03ed91daa8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:19.848281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c6945-b1ad-4d98-a7ec-03ed91daa8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:19.849697 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c6945-b1ad-4d98-a7ec-03ed91daa8b5 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:19.858037 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1247/2479] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:19.944331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c50fd-223b-4c16-a32e-6a40da336428 None None] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:19.944627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c50fd-223b-4c16-a32e-6a40da336428 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:19.944906 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c50fd-223b-4c16-a32e-6a40da336428 None None] PATH_INFO: `/` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:19.946299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1233/2480] 10.222.0.57 () {54 vars in 921 bytes} [Tue Aug 2 21:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:49:19.951625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93006885-b88c-465d-aee8-5fa1a467afad None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:19.951914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93006885-b88c-465d-aee8-5fa1a467afad None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:19.952225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93006885-b88c-465d-aee8-5fa1a467afad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:19.972411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-93006885-b88c-465d-aee8-5fa1a467afad None None] MFA Rules not processed for user `cab044fcd0dd449eafaccb81606d15ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:19.973546 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-93006885-b88c-465d-aee8-5fa1a467afad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:19.983322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1248/2481] 10.222.0.57 () {58 vars in 1018 bytes} [Tue Aug 2 21:49:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:19.993740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c50fd-223b-4c16-a32e-6a40da336428 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:19.995412 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bf5c50fd-223b-4c16-a32e-6a40da336428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:20.003702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:20.010391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c50fd-223b-4c16-a32e-6a40da336428 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:20.013966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d14dcc-ad27-4e3f-b13d-ebe168b1049c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:20.014575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d14dcc-ad27-4e3f-b13d-ebe168b1049c service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:20.014860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d14dcc-ad27-4e3f-b13d-ebe168b1049c service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:20.015136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d14dcc-ad27-4e3f-b13d-ebe168b1049c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:20.025445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d14dcc-ad27-4e3f-b13d-ebe168b1049c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:20.026864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d14dcc-ad27-4e3f-b13d-ebe168b1049c service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:20.037448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1234/2482] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:49:21.789318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f549-51bf-4f95-b02a-f852cab76a9f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:21.790133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f549-51bf-4f95-b02a-f852cab76a9f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:21.790420 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f549-51bf-4f95-b02a-f852cab76a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:21.814867 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-83b8f549-51bf-4f95-b02a-f852cab76a9f None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:21.816095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-83b8f549-51bf-4f95-b02a-f852cab76a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:21.823560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1249/2483] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:49:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:21.836634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d14dcc-ad27-4e3f-b13d-ebe168b1049c service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:21.850176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d14dcc-ad27-4e3f-b13d-ebe168b1049c service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:21.855675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c1b3f-abcc-410a-ae6a-1ebf7f9c353f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:21.856399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c1b3f-abcc-410a-ae6a-1ebf7f9c353f service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:21.856804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c1b3f-abcc-410a-ae6a-1ebf7f9c353f service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:21.857577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c1b3f-abcc-410a-ae6a-1ebf7f9c353f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:21.874077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c1b3f-abcc-410a-ae6a-1ebf7f9c353f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:21.875760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79c1b3f-abcc-410a-ae6a-1ebf7f9c353f service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:21.884749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1235/2484] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:49:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:49:31.811023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=62 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:31.881262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=11 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:45.235113 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ff7b-59f6-4be3-8139-1b9e97c9a3eb None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:45.235627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ff7b-59f6-4be3-8139-1b9e97c9a3eb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:45.235725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ff7b-59f6-4be3-8139-1b9e97c9a3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:45.255161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c212ff7b-59f6-4be3-8139-1b9e97c9a3eb None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:45.256396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c212ff7b-59f6-4be3-8139-1b9e97c9a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:45.264606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1250/2485] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 2 21:49:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:45.277005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c1b3f-abcc-410a-ae6a-1ebf7f9c353f service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:45.287823 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c1b3f-abcc-410a-ae6a-1ebf7f9c353f service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:45.292768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1752151-5433-4884-a1c6-ca9e300c8b22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:45.293362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1752151-5433-4884-a1c6-ca9e300c8b22 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:45.293640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1752151-5433-4884-a1c6-ca9e300c8b22 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:45.293911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1752151-5433-4884-a1c6-ca9e300c8b22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:45.303368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1752151-5433-4884-a1c6-ca9e300c8b22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:45.306530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1752151-5433-4884-a1c6-ca9e300c8b22 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:45.315061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1236/2486] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:49:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:49:55.250102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:55.311772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:59.526011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ff7b-59f6-4be3-8139-1b9e97c9a3eb None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:59.527403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c212ff7b-59f6-4be3-8139-1b9e97c9a3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:59.602191 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ff7b-59f6-4be3-8139-1b9e97c9a3eb None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:59.606032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112da98-c3b9-43ba-b1dc-22a23cee5860 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:59.606642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112da98-c3b9-43ba-b1dc-22a23cee5860 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:59.606919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112da98-c3b9-43ba-b1dc-22a23cee5860 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:59.607767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112da98-c3b9-43ba-b1dc-22a23cee5860 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:59.609572 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5112da98-c3b9-43ba-b1dc-22a23cee5860 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:59.622612 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112da98-c3b9-43ba-b1dc-22a23cee5860 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:59.624032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112da98-c3b9-43ba-b1dc-22a23cee5860 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:59.634820 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1251/2487] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:02.505788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1752151-5433-4884-a1c6-ca9e300c8b22 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:02.507170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d1752151-5433-4884-a1c6-ca9e300c8b22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:02.519080 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1752151-5433-4884-a1c6-ca9e300c8b22 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:02.522902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ecc46-e76b-499b-a7ed-df54458646b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:02.523504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ecc46-e76b-499b-a7ed-df54458646b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:02.523783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ecc46-e76b-499b-a7ed-df54458646b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:02.524087 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ecc46-e76b-499b-a7ed-df54458646b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:02.525801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-494ecc46-e76b-499b-a7ed-df54458646b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:02.583434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ecc46-e76b-499b-a7ed-df54458646b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:02.584964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ecc46-e76b-499b-a7ed-df54458646b7 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:02.595420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1237/2488] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:03.356617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112da98-c3b9-43ba-b1dc-22a23cee5860 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:03.366501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112da98-c3b9-43ba-b1dc-22a23cee5860 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:03.370077 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d8c1c-b9ac-45f8-9258-596766a2a96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:03.370684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d8c1c-b9ac-45f8-9258-596766a2a96a service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:03.370967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d8c1c-b9ac-45f8-9258-596766a2a96a service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:03.371242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d8c1c-b9ac-45f8-9258-596766a2a96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:03.373719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-767d8c1c-b9ac-45f8-9258-596766a2a96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:03.430827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d8c1c-b9ac-45f8-9258-596766a2a96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:03.432300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d8c1c-b9ac-45f8-9258-596766a2a96a service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:03.441695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1252/2489] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:05.873516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ecc46-e76b-499b-a7ed-df54458646b7 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:05.882943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ecc46-e76b-499b-a7ed-df54458646b7 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:05.886541 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c5849-a855-4c0f-92df-42c876b53d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:05.887142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c5849-a855-4c0f-92df-42c876b53d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:05.887419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c5849-a855-4c0f-92df-42c876b53d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:05.887691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c5849-a855-4c0f-92df-42c876b53d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:05.890002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0c8c5849-a855-4c0f-92df-42c876b53d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:05.903483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c5849-a855-4c0f-92df-42c876b53d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:05.905563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c5849-a855-4c0f-92df-42c876b53d35 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:05.916539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1238/2490] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:12.901227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1529-f811-4097-af7a-ef0a9536e9f3 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:12.901785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1529-f811-4097-af7a-ef0a9536e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:12.901785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f1529-f811-4097-af7a-ef0a9536e9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:12.925004 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-625f1529-f811-4097-af7a-ef0a9536e9f3 None None] MFA Rules not processed for user `5377fd0bccf748dda1d0192080253dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:12.926524 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-625f1529-f811-4097-af7a-ef0a9536e9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:12.937119 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1253/2491] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:14.314126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c5849-a855-4c0f-92df-42c876b53d35 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:14.324564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c5849-a855-4c0f-92df-42c876b53d35 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:14.329405 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:14.330250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:14.330687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:14.330970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:14.332888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:14.410277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:14.411732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:14.426160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1239/2492] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:19.346629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f1529-f811-4097-af7a-ef0a9536e9f3 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:19.361025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f1529-f811-4097-af7a-ef0a9536e9f3 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:19.368848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1f36-d174-47b6-a9ac-f69078754cf7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:19.369945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1f36-d174-47b6-a9ac-f69078754cf7 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:19.370187 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1f36-d174-47b6-a9ac-f69078754cf7 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:19.370615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1f36-d174-47b6-a9ac-f69078754cf7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:19.373449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4b8f1f36-d174-47b6-a9ac-f69078754cf7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:19.388165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f1f36-d174-47b6-a9ac-f69078754cf7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:19.389885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f1f36-d174-47b6-a9ac-f69078754cf7 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:19.404461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1254/2493] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:23.742014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:23.743578 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:23.756602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247db55d-8f0e-4b01-bc09-bf9b01b41669 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:23.761692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:23.762322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:23.762613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:23.762888 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] PATH_INFO: `/v3/users/228eefac4dab4b5d937bf66ea6e0eb8e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:23.764615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] RBAC: Authorizing `identity:delete_user(user_id=228eefac4dab4b5d937bf66ea6e0eb8e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:23.766535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:23.828980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '228eefac4dab4b5d937bf66ea6e0eb8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:23.836110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '228eefac4dab4b5d937bf66ea6e0eb8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:23.844576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '228eefac4dab4b5d937bf66ea6e0eb8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:23.845193 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '228eefac4dab4b5d937bf66ea6e0eb8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:23.845798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '228eefac4dab4b5d937bf66ea6e0eb8e'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:23.853462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:23.864614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1240/2494] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:23 2022] DELETE /identity/v3/users/228eefac4dab4b5d937bf66ea6e0eb8e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:24.042114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1f36-d174-47b6-a9ac-f69078754cf7 service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:24.054226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1f36-d174-47b6-a9ac-f69078754cf7 service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:24.116092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:24.116787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:24.117072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:24.117349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] PATH_INFO: `/v3/projects/e94861fe088e4dc091bfa76d5a100fd5` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:24.118561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94861fe088e4dc091bfa76d5a100fd5)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:24.120549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:24.123783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:24.175374 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94861fe088e4dc091bfa76d5a100fd5', 'request_id': 'req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.181956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94861fe088e4dc091bfa76d5a100fd5', 'request_id': 'req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.190723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94861fe088e4dc091bfa76d5a100fd5', 'request_id': 'req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.202115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] The token cache is being invalidate because project e94861fe088e4dc091bfa76d5a100fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:24.202391 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.203053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.204833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1255/2495] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:24 2022] DELETE /identity/v3/projects/e94861fe088e4dc091bfa76d5a100fd5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:24.208818 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:24.210377 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:24.224204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36305d95-0b9c-4a12-ac6a-164cf7f1023e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:24.287897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:24.288588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:24.288869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:24.289146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] PATH_INFO: `/v3/users/27666d500143473ca34b3b0578d443a8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:24.290327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27666d500143473ca34b3b0578d443a8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:24.292296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:24.343794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27666d500143473ca34b3b0578d443a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.350753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27666d500143473ca34b3b0578d443a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.358131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27666d500143473ca34b3b0578d443a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.358789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27666d500143473ca34b3b0578d443a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.359394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27666d500143473ca34b3b0578d443a8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.377312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1241/2496] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:24 2022] DELETE /identity/v3/users/27666d500143473ca34b3b0578d443a8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:24.553321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:24.554795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:24.568076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e6674-87a9-4dd1-9f64-4bb92ba0b2a8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:24.632640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:24.633274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:24.633550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:24.633819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] PATH_INFO: `/v3/projects/e251ef63a07840498f6fbde1b6a5fa27` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:24.634974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e251ef63a07840498f6fbde1b6a5fa27)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:24.637011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:24.683289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e251ef63a07840498f6fbde1b6a5fa27', 'request_id': 'req-1519bd9b-e3a0-46cc-95a4-a721082f4c56'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.689204 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e251ef63a07840498f6fbde1b6a5fa27', 'request_id': 'req-1519bd9b-e3a0-46cc-95a4-a721082f4c56'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.696385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e251ef63a07840498f6fbde1b6a5fa27', 'request_id': 'req-1519bd9b-e3a0-46cc-95a4-a721082f4c56'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.706936 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] The token cache is being invalidate because project e251ef63a07840498f6fbde1b6a5fa27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:24.707221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.707876 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:24.709416 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1256/2497] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:24 2022] DELETE /identity/v3/projects/e251ef63a07840498f6fbde1b6a5fa27 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:24.934822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:24.938227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:24.999764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b972fa8f-99ca-401b-b4ce-a81845896df3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:25.025513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:25.053865 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7b72e-3124-4a08-87c5-3059b4189baf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:25.054590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b72e-3124-4a08-87c5-3059b4189baf service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:25.054875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b72e-3124-4a08-87c5-3059b4189baf service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:25.055201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7b72e-3124-4a08-87c5-3059b4189baf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:25.057392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8ea7b72e-3124-4a08-87c5-3059b4189baf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:25.124709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7b72e-3124-4a08-87c5-3059b4189baf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:25.126136 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7b72e-3124-4a08-87c5-3059b4189baf service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:25.135505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1242/2498] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:28.481265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:28.483614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:28.497696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1519bd9b-e3a0-46cc-95a4-a721082f4c56 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:28.502280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:28.502917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:28.503200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:28.503479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] PATH_INFO: `/v3/users/3d13a56d271447bb936cea12e693b22f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:28.517461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d13a56d271447bb936cea12e693b22f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:28.519394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:28.524556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:28.568736 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d13a56d271447bb936cea12e693b22f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.580772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d13a56d271447bb936cea12e693b22f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.589954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d13a56d271447bb936cea12e693b22f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.590667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d13a56d271447bb936cea12e693b22f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.591275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-a1dbe9ba-507e-4453-b705-94ca2c682f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d13a56d271447bb936cea12e693b22f'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.605109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1257/2499] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:28 2022] DELETE /identity/v3/users/3d13a56d271447bb936cea12e693b22f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:28.780895 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7b72e-3124-4a08-87c5-3059b4189baf service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:28.791077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7b72e-3124-4a08-87c5-3059b4189baf service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:28.855721 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:28.856389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:28.856673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:28.857545 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] PATH_INFO: `/v3/projects/6c98a5a02318476daf8318190d7e1a76` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:28.868017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c98a5a02318476daf8318190d7e1a76)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:28.870404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:28.917916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c98a5a02318476daf8318190d7e1a76', 'request_id': 'req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.925670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c98a5a02318476daf8318190d7e1a76', 'request_id': 'req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.932526 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c98a5a02318476daf8318190d7e1a76', 'request_id': 'req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.939631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:28.944793 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] The token cache is being invalidate because project 6c98a5a02318476daf8318190d7e1a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:28.945251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.946074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-c48ea5dc-d237-4dbd-ad08-d4f9d6c0e18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:28.948627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1243/2500] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:28 2022] DELETE /identity/v3/projects/6c98a5a02318476daf8318190d7e1a76 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:28.953386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a382024-d67c-4fcb-add5-68968676b603 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:28.953675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a382024-d67c-4fcb-add5-68968676b603 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:28.953953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a382024-d67c-4fcb-add5-68968676b603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:28.974251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8a382024-d67c-4fcb-add5-68968676b603 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:28.975358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8a382024-d67c-4fcb-add5-68968676b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:29.039477 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1258/2501] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:29.049096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a6b55-647a-4a8b-ac94-2521c15d758e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.049498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a6b55-647a-4a8b-ac94-2521c15d758e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.049967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a6b55-647a-4a8b-ac94-2521c15d758e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.070004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-aa3a6b55-647a-4a8b-ac94-2521c15d758e None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:29.071230 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-aa3a6b55-647a-4a8b-ac94-2521c15d758e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:29.079763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1244/2502] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:29.083895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a382024-d67c-4fcb-add5-68968676b603 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.094038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a382024-d67c-4fcb-add5-68968676b603 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.098550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7068ff5-f7c6-464e-8e7d-c6baf7d8808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.099152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7068ff5-f7c6-464e-8e7d-c6baf7d8808f admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.099427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7068ff5-f7c6-464e-8e7d-c6baf7d8808f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.099697 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7068ff5-f7c6-464e-8e7d-c6baf7d8808f admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.100411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7068ff5-f7c6-464e-8e7d-c6baf7d8808f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:50:29.100715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7068ff5-f7c6-464e-8e7d-c6baf7d8808f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.102301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7068ff5-f7c6-464e-8e7d-c6baf7d8808f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.114581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1259/2503] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:50:29.118966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a6b55-647a-4a8b-ac94-2521c15d758e None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.128365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a6b55-647a-4a8b-ac94-2521c15d758e None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.133133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd217926-c017-4319-a263-7d50ca1a3f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.133789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217926-c017-4319-a263-7d50ca1a3f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.134032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217926-c017-4319-a263-7d50ca1a3f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.134562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd217926-c017-4319-a263-7d50ca1a3f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.134984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd217926-c017-4319-a263-7d50ca1a3f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.136952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd217926-c017-4319-a263-7d50ca1a3f10 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.194643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1245/2504] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:29 2022] POST /identity/v3/projects => generated 405 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:29.196033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7068ff5-f7c6-464e-8e7d-c6baf7d8808f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.206931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7068ff5-f7c6-464e-8e7d-c6baf7d8808f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.267840 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554ed08-a760-4eae-9231-072e6df4b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.268404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554ed08-a760-4eae-9231-072e6df4b1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.268682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554ed08-a760-4eae-9231-072e6df4b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.268952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554ed08-a760-4eae-9231-072e6df4b1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.269637 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554ed08-a760-4eae-9231-072e6df4b1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.271849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554ed08-a760-4eae-9231-072e6df4b1d6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.289858 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:29.299863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1260/2505] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:29 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:29.300098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd217926-c017-4319-a263-7d50ca1a3f10 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.310831 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd217926-c017-4319-a263-7d50ca1a3f10 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.315430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aff0c9-7014-410a-9d0a-19678a6980d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.316033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff0c9-7014-410a-9d0a-19678a6980d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.316383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff0c9-7014-410a-9d0a-19678a6980d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.316658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aff0c9-7014-410a-9d0a-19678a6980d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.317382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aff0c9-7014-410a-9d0a-19678a6980d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.318993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aff0c9-7014-410a-9d0a-19678a6980d2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.329629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1246/2506] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:29.333644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554ed08-a760-4eae-9231-072e6df4b1d6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.344317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554ed08-a760-4eae-9231-072e6df4b1d6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.349189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a27a-976d-4555-9b27-bb53f9d6facc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.349831 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a27a-976d-4555-9b27-bb53f9d6facc admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.350138 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a27a-976d-4555-9b27-bb53f9d6facc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.350410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a27a-976d-4555-9b27-bb53f9d6facc admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.351103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116a27a-976d-4555-9b27-bb53f9d6facc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.352781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116a27a-976d-4555-9b27-bb53f9d6facc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.363460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1261/2507] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:29.367592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aff0c9-7014-410a-9d0a-19678a6980d2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.378317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aff0c9-7014-410a-9d0a-19678a6980d2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.382940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13323afb-360b-46a9-895d-f339623b465c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.383588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13323afb-360b-46a9-895d-f339623b465c admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.383864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13323afb-360b-46a9-895d-f339623b465c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.384148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13323afb-360b-46a9-895d-f339623b465c admin admin] PATH_INFO: `/v3/projects/1602c2b71f634e50b08131c4711f512f/users/1533928732064a4aa908422f8f6dac9d/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.399624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13323afb-360b-46a9-895d-f339623b465c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1602c2b71f634e50b08131c4711f512f, user_id=1533928732064a4aa908422f8f6dac9d, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.402291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13323afb-360b-46a9-895d-f339623b465c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.415618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1247/2508] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:29 2022] PUT /identity/v3/projects/1602c2b71f634e50b08131c4711f512f/users/1533928732064a4aa908422f8f6dac9d/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:29.425732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4bcb1-1d7d-4d96-a903-44de81a2f407 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.426022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4bcb1-1d7d-4d96-a903-44de81a2f407 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.426292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4bcb1-1d7d-4d96-a903-44de81a2f407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.454263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-bda4bcb1-1d7d-4d96-a903-44de81a2f407 None None] MFA Rules not processed for user `1533928732064a4aa908422f8f6dac9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:29.455458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bda4bcb1-1d7d-4d96-a903-44de81a2f407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:29.516022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1262/2509] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:29 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:29.520600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13323afb-360b-46a9-895d-f339623b465c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.585516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13323afb-360b-46a9-895d-f339623b465c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.590114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4985777-226e-4fb1-b7f1-95e18fb70b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.590727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4985777-226e-4fb1-b7f1-95e18fb70b1a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.591006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4985777-226e-4fb1-b7f1-95e18fb70b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.591275 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4985777-226e-4fb1-b7f1-95e18fb70b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.591949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4985777-226e-4fb1-b7f1-95e18fb70b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.593892 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4985777-226e-4fb1-b7f1-95e18fb70b1a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.619938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1248/2510] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:29 2022] POST /identity/v3/projects => generated 405 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:29.624696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4bcb1-1d7d-4d96-a903-44de81a2f407 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.635135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4bcb1-1d7d-4d96-a903-44de81a2f407 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.691943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9492b97-eb1a-4ff9-8750-19562f4dbbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.692577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9492b97-eb1a-4ff9-8750-19562f4dbbf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.692862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9492b97-eb1a-4ff9-8750-19562f4dbbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.693128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9492b97-eb1a-4ff9-8750-19562f4dbbf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.693778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9492b97-eb1a-4ff9-8750-19562f4dbbf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.695696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9492b97-eb1a-4ff9-8750-19562f4dbbf4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.716916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1263/2511] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:29 2022] POST /identity/v3/users => generated 309 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:29.720936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4985777-226e-4fb1-b7f1-95e18fb70b1a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.731152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4985777-226e-4fb1-b7f1-95e18fb70b1a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.736276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d408fee-ffcc-4b71-85de-31c4666b6bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.736877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d408fee-ffcc-4b71-85de-31c4666b6bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.737154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d408fee-ffcc-4b71-85de-31c4666b6bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.737422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d408fee-ffcc-4b71-85de-31c4666b6bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.738104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d408fee-ffcc-4b71-85de-31c4666b6bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.739781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d408fee-ffcc-4b71-85de-31c4666b6bc2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.750804 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1249/2512] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:29.754945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9492b97-eb1a-4ff9-8750-19562f4dbbf4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.764973 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9492b97-eb1a-4ff9-8750-19562f4dbbf4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.769548 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecadbc-70bf-4981-b714-4d20adc9fd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.770206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecadbc-70bf-4981-b714-4d20adc9fd95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.770493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecadbc-70bf-4981-b714-4d20adc9fd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.770822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecadbc-70bf-4981-b714-4d20adc9fd95 admin admin] PATH_INFO: `/v3/projects/34925d0982d541cf93a451959a6b4785/users/4a03b8250daf4791822efd11245683e1/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.786714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecadbc-70bf-4981-b714-4d20adc9fd95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34925d0982d541cf93a451959a6b4785, user_id=4a03b8250daf4791822efd11245683e1, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.789403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecadbc-70bf-4981-b714-4d20adc9fd95 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.803905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1264/2513] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:29 2022] PUT /identity/v3/projects/34925d0982d541cf93a451959a6b4785/users/4a03b8250daf4791822efd11245683e1/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:29.807961 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d408fee-ffcc-4b71-85de-31c4666b6bc2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.818233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d408fee-ffcc-4b71-85de-31c4666b6bc2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.875977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc33b06-f023-4158-9988-f633c0f1cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.876638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc33b06-f023-4158-9988-f633c0f1cee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.876905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc33b06-f023-4158-9988-f633c0f1cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.877172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc33b06-f023-4158-9988-f633c0f1cee9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.877860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc33b06-f023-4158-9988-f633c0f1cee9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.879423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc33b06-f023-4158-9988-f633c0f1cee9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.880734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:29.897239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1250/2514] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:29.897803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecadbc-70bf-4981-b714-4d20adc9fd95 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:29.908978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecadbc-70bf-4981-b714-4d20adc9fd95 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:29.913711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b720ec-f62a-479d-94f7-304ca584d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:29.914494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b720ec-f62a-479d-94f7-304ca584d3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.914777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b720ec-f62a-479d-94f7-304ca584d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.915052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b720ec-f62a-479d-94f7-304ca584d3f0 admin admin] PATH_INFO: `/v3/projects/34925d0982d541cf93a451959a6b4785/users/4a03b8250daf4791822efd11245683e1/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.917039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b720ec-f62a-479d-94f7-304ca584d3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34925d0982d541cf93a451959a6b4785, user_id=4a03b8250daf4791822efd11245683e1, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:29.920557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b720ec-f62a-479d-94f7-304ca584d3f0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:29.931409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1265/2515] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:29 2022] PUT /identity/v3/projects/34925d0982d541cf93a451959a6b4785/users/4a03b8250daf4791822efd11245683e1/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:29.942288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763b5e-53d7-48e5-9ee9-e9452dc57f6a None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:29.942650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763b5e-53d7-48e5-9ee9-e9452dc57f6a None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:29.942940 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33763b5e-53d7-48e5-9ee9-e9452dc57f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:29.971924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-33763b5e-53d7-48e5-9ee9-e9452dc57f6a None None] MFA Rules not processed for user `4a03b8250daf4791822efd11245683e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:29.973198 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-33763b5e-53d7-48e5-9ee9-e9452dc57f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:30.051989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1251/2516] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:30.067502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b720ec-f62a-479d-94f7-304ca584d3f0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:30.069254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-68b720ec-f62a-479d-94f7-304ca584d3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:30.104829 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:30.131683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b720ec-f62a-479d-94f7-304ca584d3f0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:30.135298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d5914-1eef-4c35-a9e3-30cc095bdfcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:30.135910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d5914-1eef-4c35-a9e3-30cc095bdfcf service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:30.136216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d5914-1eef-4c35-a9e3-30cc095bdfcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:30.136489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d5914-1eef-4c35-a9e3-30cc095bdfcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:30.146240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d5914-1eef-4c35-a9e3-30cc095bdfcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:30.147671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d5914-1eef-4c35-a9e3-30cc095bdfcf service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:30.157891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1266/2517] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:30 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:30.316505 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763b5e-53d7-48e5-9ee9-e9452dc57f6a None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:30.381874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33763b5e-53d7-48e5-9ee9-e9452dc57f6a None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:30.386638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:30.387282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:30.387564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:30.387846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] PATH_INFO: `/v3/users/1533928732064a4aa908422f8f6dac9d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:30.389604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1533928732064a4aa908422f8f6dac9d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:30.391623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:30.438620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1533928732064a4aa908422f8f6dac9d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:30.445558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1533928732064a4aa908422f8f6dac9d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:30.453694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1533928732064a4aa908422f8f6dac9d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:30.454348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1533928732064a4aa908422f8f6dac9d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:30.455058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1533928732064a4aa908422f8f6dac9d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:30.468576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:30.473329 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1252/2518] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:30 2022] DELETE /identity/v3/users/1533928732064a4aa908422f8f6dac9d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:30.478126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b33e3-2f7f-47bf-942b-78cfe1ccc392 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:30.478413 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b33e3-2f7f-47bf-942b-78cfe1ccc392 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:30.478687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b33e3-2f7f-47bf-942b-78cfe1ccc392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:30.497638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5c1b33e3-2f7f-47bf-942b-78cfe1ccc392 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:30.499425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5c1b33e3-2f7f-47bf-942b-78cfe1ccc392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:30.557756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1267/2519] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:30.567871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:30.569296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:30.625647 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69070b1-eb6a-4ebf-a40a-f87e76fdc504 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:30.629228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093913-cab1-44eb-8d7c-8d336bf4adad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:30.629856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093913-cab1-44eb-8d7c-8d336bf4adad service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:30.630139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093913-cab1-44eb-8d7c-8d336bf4adad service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:30.630407 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093913-cab1-44eb-8d7c-8d336bf4adad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:30.639458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5093913-cab1-44eb-8d7c-8d336bf4adad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:30.640898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5093913-cab1-44eb-8d7c-8d336bf4adad service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:30.650434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1253/2520] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:30.912268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b33e3-2f7f-47bf-942b-78cfe1ccc392 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:30.913824 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5c1b33e3-2f7f-47bf-942b-78cfe1ccc392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:30.932268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b33e3-2f7f-47bf-942b-78cfe1ccc392 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:30.938115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:30.938758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:30.939063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:30.939394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] PATH_INFO: `/v3/projects/1602c2b71f634e50b08131c4711f512f` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:30.940683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1602c2b71f634e50b08131c4711f512f)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:30.942584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:30.989009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1602c2b71f634e50b08131c4711f512f', 'request_id': 'req-098a80d9-6292-47e3-a01a-ab5210f4ff15'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:30.995042 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1602c2b71f634e50b08131c4711f512f', 'request_id': 'req-098a80d9-6292-47e3-a01a-ab5210f4ff15'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.002998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1602c2b71f634e50b08131c4711f512f', 'request_id': 'req-098a80d9-6292-47e3-a01a-ab5210f4ff15'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.013818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] The token cache is being invalidate because project 1602c2b71f634e50b08131c4711f512f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:31.014118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.014749 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.016268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1268/2521] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:30 2022] DELETE /identity/v3/projects/1602c2b71f634e50b08131c4711f512f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:31.020367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093913-cab1-44eb-8d7c-8d336bf4adad service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:31.031642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093913-cab1-44eb-8d7c-8d336bf4adad service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:31.100905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:31.101573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:31.101763 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:31.102478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] PATH_INFO: `/v3/users/4a03b8250daf4791822efd11245683e1` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:31.104171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a03b8250daf4791822efd11245683e1)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:31.106524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:31.167720 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a03b8250daf4791822efd11245683e1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.175269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a03b8250daf4791822efd11245683e1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.184759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a03b8250daf4791822efd11245683e1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.186931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a03b8250daf4791822efd11245683e1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.188152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-00247280-2e46-41d0-b938-6965854feec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a03b8250daf4791822efd11245683e1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.210615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1254/2522] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:31 2022] DELETE /identity/v3/users/4a03b8250daf4791822efd11245683e1 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:31.493382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:31.495293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:31.516344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a80d9-6292-47e3-a01a-ab5210f4ff15 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:31.587768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:31.594903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:31.595801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:31.596208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:31.596715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] PATH_INFO: `/v3/projects/34925d0982d541cf93a451959a6b4785` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:31.598076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=34925d0982d541cf93a451959a6b4785)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:31.600910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:31.656533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34925d0982d541cf93a451959a6b4785', 'request_id': 'req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.663645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34925d0982d541cf93a451959a6b4785', 'request_id': 'req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.675357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34925d0982d541cf93a451959a6b4785', 'request_id': 'req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.690879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] The token cache is being invalidate because project 34925d0982d541cf93a451959a6b4785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:31.691331 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.692120 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4af00e85-73ab-42a1-80e2-3ecd87cb7c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:31.694330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1269/2523] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:31 2022] DELETE /identity/v3/projects/34925d0982d541cf93a451959a6b4785 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:31.699372 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e286d91-082a-43ca-85cf-10e04458d605 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:31.699666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e286d91-082a-43ca-85cf-10e04458d605 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:31.699991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e286d91-082a-43ca-85cf-10e04458d605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:31.723488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4e286d91-082a-43ca-85cf-10e04458d605 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:31.725023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4e286d91-082a-43ca-85cf-10e04458d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:31.744321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:31.792659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1255/2524] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:31.801813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72b3fb-d7ec-460a-be80-bb56501b1325 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:31.801932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72b3fb-d7ec-460a-be80-bb56501b1325 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:31.802195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72b3fb-d7ec-460a-be80-bb56501b1325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:31.826801 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0a72b3fb-d7ec-460a-be80-bb56501b1325 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:31.828057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0a72b3fb-d7ec-460a-be80-bb56501b1325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:31.836126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1270/2525] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:31.840398 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e286d91-082a-43ca-85cf-10e04458d605 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:31.850166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e286d91-082a-43ca-85cf-10e04458d605 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:31.854848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe413f-f0ee-4c9f-9451-d7b17709aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:31.855456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe413f-f0ee-4c9f-9451-d7b17709aa8c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:31.855730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe413f-f0ee-4c9f-9451-d7b17709aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:31.856004 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe413f-f0ee-4c9f-9451-d7b17709aa8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:31.856720 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe413f-f0ee-4c9f-9451-d7b17709aa8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:50:31.857557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe413f-f0ee-4c9f-9451-d7b17709aa8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:31.859160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe413f-f0ee-4c9f-9451-d7b17709aa8c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:31.874916 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1256/2526] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:50:31.876177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72b3fb-d7ec-460a-be80-bb56501b1325 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:31.885534 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72b3fb-d7ec-460a-be80-bb56501b1325 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:31.890486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464b709-5f47-4a6f-8638-aaf1266f311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:31.891114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464b709-5f47-4a6f-8638-aaf1266f311a admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:31.891402 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464b709-5f47-4a6f-8638-aaf1266f311a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:31.891678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464b709-5f47-4a6f-8638-aaf1266f311a admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:31.892373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464b709-5f47-4a6f-8638-aaf1266f311a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:31.894298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464b709-5f47-4a6f-8638-aaf1266f311a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:31.922347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1271/2527] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:31 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:31.926504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe413f-f0ee-4c9f-9451-d7b17709aa8c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:31.937213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe413f-f0ee-4c9f-9451-d7b17709aa8c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:31.995656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36574202-c324-47bd-968b-3ec906e3f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:31.996300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574202-c324-47bd-968b-3ec906e3f20e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:31.996585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574202-c324-47bd-968b-3ec906e3f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:31.996858 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36574202-c324-47bd-968b-3ec906e3f20e admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:31.997531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36574202-c324-47bd-968b-3ec906e3f20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.000005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36574202-c324-47bd-968b-3ec906e3f20e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.021513 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1257/2528] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:31 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:32.025816 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464b709-5f47-4a6f-8638-aaf1266f311a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.036065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464b709-5f47-4a6f-8638-aaf1266f311a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.040981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b74fb0-5689-4bef-9bb0-fa04acc036bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.041618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b74fb0-5689-4bef-9bb0-fa04acc036bc admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.041896 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b74fb0-5689-4bef-9bb0-fa04acc036bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.042164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b74fb0-5689-4bef-9bb0-fa04acc036bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.042859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b74fb0-5689-4bef-9bb0-fa04acc036bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.045059 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b74fb0-5689-4bef-9bb0-fa04acc036bc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.055324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1272/2529] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:32.059213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36574202-c324-47bd-968b-3ec906e3f20e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.069852 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36574202-c324-47bd-968b-3ec906e3f20e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.074460 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26557345-aff0-4c80-8620-0db683e02ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.075062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557345-aff0-4c80-8620-0db683e02ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.075346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557345-aff0-4c80-8620-0db683e02ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.075622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557345-aff0-4c80-8620-0db683e02ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.076374 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26557345-aff0-4c80-8620-0db683e02ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.077949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26557345-aff0-4c80-8620-0db683e02ea7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.088553 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1258/2530] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:32.092800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b74fb0-5689-4bef-9bb0-fa04acc036bc admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.102592 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b74fb0-5689-4bef-9bb0-fa04acc036bc admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.107597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d21b5-a789-4d43-aa6a-5139905bb645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.108272 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d21b5-a789-4d43-aa6a-5139905bb645 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.108550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d21b5-a789-4d43-aa6a-5139905bb645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.108821 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d21b5-a789-4d43-aa6a-5139905bb645 admin admin] PATH_INFO: `/v3/projects/9b07aae03bbd4dd4901bb373da4ab594/users/379279b67f504582b2ed7c2de9d2d44e/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.122662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d21b5-a789-4d43-aa6a-5139905bb645 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b07aae03bbd4dd4901bb373da4ab594, user_id=379279b67f504582b2ed7c2de9d2d44e, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.125404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d21b5-a789-4d43-aa6a-5139905bb645 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.139051 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1273/2531] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:32 2022] PUT /identity/v3/projects/9b07aae03bbd4dd4901bb373da4ab594/users/379279b67f504582b2ed7c2de9d2d44e/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:32.149569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec1273-b4c4-4af5-9ada-578917285159 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.149796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec1273-b4c4-4af5-9ada-578917285159 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.150072 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec1273-b4c4-4af5-9ada-578917285159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.177683 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f3ec1273-b4c4-4af5-9ada-578917285159 None None] MFA Rules not processed for user `379279b67f504582b2ed7c2de9d2d44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:32.178878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f3ec1273-b4c4-4af5-9ada-578917285159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:32.241801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1259/2532] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:32.246246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d21b5-a789-4d43-aa6a-5139905bb645 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.307574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d21b5-a789-4d43-aa6a-5139905bb645 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.312734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c2766-a112-4747-a84a-c699c4a9f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.313346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2766-a112-4747-a84a-c699c4a9f3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.313633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2766-a112-4747-a84a-c699c4a9f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.313909 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c2766-a112-4747-a84a-c699c4a9f3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.314594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c2766-a112-4747-a84a-c699c4a9f3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.316553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c2766-a112-4747-a84a-c699c4a9f3b8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.342315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1274/2533] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:32 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:32.346393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec1273-b4c4-4af5-9ada-578917285159 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.357116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec1273-b4c4-4af5-9ada-578917285159 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.369127 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:32.413954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d63b-0299-4fc1-8dff-a60538bf881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.414481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d63b-0299-4fc1-8dff-a60538bf881c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.414761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d63b-0299-4fc1-8dff-a60538bf881c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.415026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d63b-0299-4fc1-8dff-a60538bf881c admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.415705 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d63b-0299-4fc1-8dff-a60538bf881c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.417632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d63b-0299-4fc1-8dff-a60538bf881c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.438071 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1260/2534] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:32 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:32.442195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c2766-a112-4747-a84a-c699c4a9f3b8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.452264 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c2766-a112-4747-a84a-c699c4a9f3b8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.456762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892453bc-9568-43b4-9cb2-da71cc637c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.457359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892453bc-9568-43b4-9cb2-da71cc637c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.457638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892453bc-9568-43b4-9cb2-da71cc637c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.457905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892453bc-9568-43b4-9cb2-da71cc637c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.458589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892453bc-9568-43b4-9cb2-da71cc637c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.460203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892453bc-9568-43b4-9cb2-da71cc637c59 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.462167 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:32.472845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1275/2535] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:32.476795 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d63b-0299-4fc1-8dff-a60538bf881c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.487251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d63b-0299-4fc1-8dff-a60538bf881c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.491845 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214cea0-ff82-4132-a6dd-517c619bff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.492530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214cea0-ff82-4132-a6dd-517c619bff2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.492816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214cea0-ff82-4132-a6dd-517c619bff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.493095 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214cea0-ff82-4132-a6dd-517c619bff2a admin admin] PATH_INFO: `/v3/projects/545758457672477ab21c7f4319718fab/users/408f47e401664c8c8f749cdc3721a7b9/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.507375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214cea0-ff82-4132-a6dd-517c619bff2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=545758457672477ab21c7f4319718fab, user_id=408f47e401664c8c8f749cdc3721a7b9, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.510111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214cea0-ff82-4132-a6dd-517c619bff2a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.523455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1261/2536] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:32 2022] PUT /identity/v3/projects/545758457672477ab21c7f4319718fab/users/408f47e401664c8c8f749cdc3721a7b9/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:32.527481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892453bc-9568-43b4-9cb2-da71cc637c59 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.538017 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892453bc-9568-43b4-9cb2-da71cc637c59 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.596533 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3321feb-1d34-4eb9-b3b7-c0572db86fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.597378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3321feb-1d34-4eb9-b3b7-c0572db86fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.597378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3321feb-1d34-4eb9-b3b7-c0572db86fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.597378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3321feb-1d34-4eb9-b3b7-c0572db86fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.598008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3321feb-1d34-4eb9-b3b7-c0572db86fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.600038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3321feb-1d34-4eb9-b3b7-c0572db86fe1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.610632 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1276/2537] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:32.614859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214cea0-ff82-4132-a6dd-517c619bff2a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.624965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214cea0-ff82-4132-a6dd-517c619bff2a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.629572 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67eed72-1252-49ec-b08f-b4b969241e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.630225 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67eed72-1252-49ec-b08f-b4b969241e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.630508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67eed72-1252-49ec-b08f-b4b969241e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.630782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67eed72-1252-49ec-b08f-b4b969241e88 admin admin] PATH_INFO: `/v3/projects/545758457672477ab21c7f4319718fab/users/408f47e401664c8c8f749cdc3721a7b9/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.632841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67eed72-1252-49ec-b08f-b4b969241e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545758457672477ab21c7f4319718fab, user_id=408f47e401664c8c8f749cdc3721a7b9, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.636183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67eed72-1252-49ec-b08f-b4b969241e88 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.648041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1262/2538] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:32 2022] PUT /identity/v3/projects/545758457672477ab21c7f4319718fab/users/408f47e401664c8c8f749cdc3721a7b9/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:32.658227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada2b06-9690-402e-a7b2-28528076d37e None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.658519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada2b06-9690-402e-a7b2-28528076d37e None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.658823 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada2b06-9690-402e-a7b2-28528076d37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.687050 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9ada2b06-9690-402e-a7b2-28528076d37e None None] MFA Rules not processed for user `408f47e401664c8c8f749cdc3721a7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:32.688223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9ada2b06-9690-402e-a7b2-28528076d37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:32.768260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1277/2539] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:32.775575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67eed72-1252-49ec-b08f-b4b969241e88 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:32.777393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f67eed72-1252-49ec-b08f-b4b969241e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:32.861436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67eed72-1252-49ec-b08f-b4b969241e88 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:32.865121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae3bb8-155d-4c1a-995e-7f96f6bb900b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:32.865743 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae3bb8-155d-4c1a-995e-7f96f6bb900b service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:32.866103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae3bb8-155d-4c1a-995e-7f96f6bb900b service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:32.866723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae3bb8-155d-4c1a-995e-7f96f6bb900b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:32.876504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae3bb8-155d-4c1a-995e-7f96f6bb900b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:32.877943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae3bb8-155d-4c1a-995e-7f96f6bb900b service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:32.889194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1263/2540] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:32 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:33.325994 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada2b06-9690-402e-a7b2-28528076d37e None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:33.386902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada2b06-9690-402e-a7b2-28528076d37e None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:33.391932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:33.392630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:33.392910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:33.393184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] PATH_INFO: `/v3/users/379279b67f504582b2ed7c2de9d2d44e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:33.394368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379279b67f504582b2ed7c2de9d2d44e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:33.396598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:33.419584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:33.445487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379279b67f504582b2ed7c2de9d2d44e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:33.457695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379279b67f504582b2ed7c2de9d2d44e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:33.464410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379279b67f504582b2ed7c2de9d2d44e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:33.465073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379279b67f504582b2ed7c2de9d2d44e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:33.465675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379279b67f504582b2ed7c2de9d2d44e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:33.479111 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1278/2541] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:33 2022] DELETE /identity/v3/users/379279b67f504582b2ed7c2de9d2d44e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:33.483713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15853e-0c90-4b80-b558-a93d94d5cfbe None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:33.484262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15853e-0c90-4b80-b558-a93d94d5cfbe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:33.484373 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15853e-0c90-4b80-b558-a93d94d5cfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:33.502485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5e15853e-0c90-4b80-b558-a93d94d5cfbe None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:33.503674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5e15853e-0c90-4b80-b558-a93d94d5cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:33.568839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1264/2542] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:33.580908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:33.582654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:33.643147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ba893-3fb1-4bd1-8da7-90c52f9468b1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:33.647460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705823da-1d27-4fbb-aee7-25cb8ab932b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:33.648110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705823da-1d27-4fbb-aee7-25cb8ab932b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:33.648445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705823da-1d27-4fbb-aee7-25cb8ab932b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:33.648722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705823da-1d27-4fbb-aee7-25cb8ab932b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:33.659078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705823da-1d27-4fbb-aee7-25cb8ab932b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:33.660556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705823da-1d27-4fbb-aee7-25cb8ab932b4 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:33.670021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1279/2543] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:33.738481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15853e-0c90-4b80-b558-a93d94d5cfbe None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:33.750623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15853e-0c90-4b80-b558-a93d94d5cfbe None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:33.754634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c133fb-c4f2-4468-a461-1e27e58054f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:33.755263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c133fb-c4f2-4468-a461-1e27e58054f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:33.755551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c133fb-c4f2-4468-a461-1e27e58054f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:33.755827 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c133fb-c4f2-4468-a461-1e27e58054f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:33.758097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-04c133fb-c4f2-4468-a461-1e27e58054f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:33.773980 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c133fb-c4f2-4468-a461-1e27e58054f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:33.776399 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c133fb-c4f2-4468-a461-1e27e58054f6 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:33.780942 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:33.786467 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1265/2544] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:50:34.138318 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705823da-1d27-4fbb-aee7-25cb8ab932b4 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:34.150389 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-705823da-1d27-4fbb-aee7-25cb8ab932b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:34.175722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705823da-1d27-4fbb-aee7-25cb8ab932b4 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:34.180743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45901d47-7852-425f-854c-e3560081962c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:34.181494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45901d47-7852-425f-854c-e3560081962c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:34.181883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45901d47-7852-425f-854c-e3560081962c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:34.182263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45901d47-7852-425f-854c-e3560081962c admin admin] PATH_INFO: `/v3/projects/9b07aae03bbd4dd4901bb373da4ab594` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:34.183539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45901d47-7852-425f-854c-e3560081962c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b07aae03bbd4dd4901bb373da4ab594)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:34.186147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45901d47-7852-425f-854c-e3560081962c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:34.242880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-45901d47-7852-425f-854c-e3560081962c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b07aae03bbd4dd4901bb373da4ab594', 'request_id': 'req-45901d47-7852-425f-854c-e3560081962c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.249825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-45901d47-7852-425f-854c-e3560081962c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b07aae03bbd4dd4901bb373da4ab594', 'request_id': 'req-45901d47-7852-425f-854c-e3560081962c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.259132 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-45901d47-7852-425f-854c-e3560081962c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b07aae03bbd4dd4901bb373da4ab594', 'request_id': 'req-45901d47-7852-425f-854c-e3560081962c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.269467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-45901d47-7852-425f-854c-e3560081962c admin admin] The token cache is being invalidate because project 9b07aae03bbd4dd4901bb373da4ab594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:34.269748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-45901d47-7852-425f-854c-e3560081962c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.270388 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-45901d47-7852-425f-854c-e3560081962c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.272172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1280/2545] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:34 2022] DELETE /identity/v3/projects/9b07aae03bbd4dd4901bb373da4ab594 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:34.276445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c133fb-c4f2-4468-a461-1e27e58054f6 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:34.290041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c133fb-c4f2-4468-a461-1e27e58054f6 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:34.352676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:34.353353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:34.353636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:34.353911 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] PATH_INFO: `/v3/users/408f47e401664c8c8f749cdc3721a7b9` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:34.355082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=408f47e401664c8c8f749cdc3721a7b9)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:34.357608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:34.410528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408f47e401664c8c8f749cdc3721a7b9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.417290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408f47e401664c8c8f749cdc3721a7b9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.426648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408f47e401664c8c8f749cdc3721a7b9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.427370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408f47e401664c8c8f749cdc3721a7b9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.427979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-45a787d7-01f6-4418-8c91-a260258b37b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408f47e401664c8c8f749cdc3721a7b9'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.446340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1266/2546] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:34 2022] DELETE /identity/v3/users/408f47e401664c8c8f749cdc3721a7b9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:34.752699 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45901d47-7852-425f-854c-e3560081962c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:34.754301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-45901d47-7852-425f-854c-e3560081962c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:34.774792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45901d47-7852-425f-854c-e3560081962c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:34.797136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:34.849758 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:34.850935 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:34.851422 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:34.852041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] PATH_INFO: `/v3/projects/545758457672477ab21c7f4319718fab` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:34.853920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=545758457672477ab21c7f4319718fab)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:34.856382 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:34.913903 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545758457672477ab21c7f4319718fab', 'request_id': 'req-f9fee661-1f16-45e6-b488-b30ef3a639cc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.921088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545758457672477ab21c7f4319718fab', 'request_id': 'req-f9fee661-1f16-45e6-b488-b30ef3a639cc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.929471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545758457672477ab21c7f4319718fab', 'request_id': 'req-f9fee661-1f16-45e6-b488-b30ef3a639cc'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.942830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] The token cache is being invalidate because project 545758457672477ab21c7f4319718fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:34.943166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.943894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9fee661-1f16-45e6-b488-b30ef3a639cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:34.945832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1281/2547] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:34 2022] DELETE /identity/v3/projects/545758457672477ab21c7f4319718fab => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:34.952103 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ae73d-f2c0-418d-9390-c7e8ac46a964 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:34.952639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ae73d-f2c0-418d-9390-c7e8ac46a964 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:34.952830 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ae73d-f2c0-418d-9390-c7e8ac46a964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:34.974966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-766ae73d-f2c0-418d-9390-c7e8ac46a964 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:34.977005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-766ae73d-f2c0-418d-9390-c7e8ac46a964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:35.049741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1267/2548] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:35.057552 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851f3e1-4dd5-4209-a2c7-ee1d51aa96f0 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.057904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851f3e1-4dd5-4209-a2c7-ee1d51aa96f0 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.058244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851f3e1-4dd5-4209-a2c7-ee1d51aa96f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.080383 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7851f3e1-4dd5-4209-a2c7-ee1d51aa96f0 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:35.081692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7851f3e1-4dd5-4209-a2c7-ee1d51aa96f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:35.089996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1282/2549] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:35.094882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ae73d-f2c0-418d-9390-c7e8ac46a964 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.105013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ae73d-f2c0-418d-9390-c7e8ac46a964 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.109785 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af26e81-04f8-497b-afe1-f5a0b2b005a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.110493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af26e81-04f8-497b-afe1-f5a0b2b005a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.110843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af26e81-04f8-497b-afe1-f5a0b2b005a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.111191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af26e81-04f8-497b-afe1-f5a0b2b005a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.112094 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af26e81-04f8-497b-afe1-f5a0b2b005a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:50:35.112501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af26e81-04f8-497b-afe1-f5a0b2b005a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.114220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af26e81-04f8-497b-afe1-f5a0b2b005a6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.133885 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1268/2550] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:50:35.135582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851f3e1-4dd5-4209-a2c7-ee1d51aa96f0 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.146746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851f3e1-4dd5-4209-a2c7-ee1d51aa96f0 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.151582 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276577c-350e-43ea-8acf-7c984b6d97ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.152294 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276577c-350e-43ea-8acf-7c984b6d97ba admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.152583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276577c-350e-43ea-8acf-7c984b6d97ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.152850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276577c-350e-43ea-8acf-7c984b6d97ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.153516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276577c-350e-43ea-8acf-7c984b6d97ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.155633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276577c-350e-43ea-8acf-7c984b6d97ba admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.199485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1283/2551] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:35 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:35.203664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af26e81-04f8-497b-afe1-f5a0b2b005a6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.214393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af26e81-04f8-497b-afe1-f5a0b2b005a6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.234866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:35.314069 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f588c-ccff-4fde-b897-4482296649e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.314609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f588c-ccff-4fde-b897-4482296649e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.314891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f588c-ccff-4fde-b897-4482296649e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.315166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f588c-ccff-4fde-b897-4482296649e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.315853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f588c-ccff-4fde-b897-4482296649e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.318147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f588c-ccff-4fde-b897-4482296649e2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.343898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1269/2552] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:35 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:35.347996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276577c-350e-43ea-8acf-7c984b6d97ba admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.359252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276577c-350e-43ea-8acf-7c984b6d97ba admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.365914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec7004-3666-4f0e-adcb-0e9610a43eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.366647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec7004-3666-4f0e-adcb-0e9610a43eaa admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.367029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec7004-3666-4f0e-adcb-0e9610a43eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.368178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec7004-3666-4f0e-adcb-0e9610a43eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.368178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec7004-3666-4f0e-adcb-0e9610a43eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.369909 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec7004-3666-4f0e-adcb-0e9610a43eaa admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.380371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1284/2553] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:35.384304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f588c-ccff-4fde-b897-4482296649e2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.396476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f588c-ccff-4fde-b897-4482296649e2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.405876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2323bc-7ede-4fd5-af13-4cf31d4f31ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.406608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2323bc-7ede-4fd5-af13-4cf31d4f31ff admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.406975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2323bc-7ede-4fd5-af13-4cf31d4f31ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.407315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2323bc-7ede-4fd5-af13-4cf31d4f31ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.408088 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2323bc-7ede-4fd5-af13-4cf31d4f31ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.409779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2323bc-7ede-4fd5-af13-4cf31d4f31ff admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.421496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1270/2554] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:35.425804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec7004-3666-4f0e-adcb-0e9610a43eaa admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.435850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec7004-3666-4f0e-adcb-0e9610a43eaa admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.440713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca038a91-2b54-45e5-a5a6-380c7c105dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.441377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038a91-2b54-45e5-a5a6-380c7c105dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.441659 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038a91-2b54-45e5-a5a6-380c7c105dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.441967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca038a91-2b54-45e5-a5a6-380c7c105dba admin admin] PATH_INFO: `/v3/projects/e756242428f745a59767270e77b61a3c/users/5d59f3c0e39a46cb91ed45b81fc8a762/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.458682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca038a91-2b54-45e5-a5a6-380c7c105dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e756242428f745a59767270e77b61a3c, user_id=5d59f3c0e39a46cb91ed45b81fc8a762, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.462041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca038a91-2b54-45e5-a5a6-380c7c105dba admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.476472 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1285/2555] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:35 2022] PUT /identity/v3/projects/e756242428f745a59767270e77b61a3c/users/5d59f3c0e39a46cb91ed45b81fc8a762/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:35.487001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b379e30-d3c2-4e53-83b3-09a9dff3c5ce None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.487296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b379e30-d3c2-4e53-83b3-09a9dff3c5ce None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.487665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b379e30-d3c2-4e53-83b3-09a9dff3c5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.517318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5b379e30-d3c2-4e53-83b3-09a9dff3c5ce None None] MFA Rules not processed for user `5d59f3c0e39a46cb91ed45b81fc8a762`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:35.518527 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5b379e30-d3c2-4e53-83b3-09a9dff3c5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:35.586462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1271/2556] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:35.590968 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca038a91-2b54-45e5-a5a6-380c7c105dba admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.650229 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:35.668996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca038a91-2b54-45e5-a5a6-380c7c105dba admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.676836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca8e33-3c4c-4ea6-8a1d-4ae808ba91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.678834 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca8e33-3c4c-4ea6-8a1d-4ae808ba91d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.679857 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca8e33-3c4c-4ea6-8a1d-4ae808ba91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.680830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca8e33-3c4c-4ea6-8a1d-4ae808ba91d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.681679 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca8e33-3c4c-4ea6-8a1d-4ae808ba91d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.684384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca8e33-3c4c-4ea6-8a1d-4ae808ba91d5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.720183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1286/2557] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:35 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:35.724950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b379e30-d3c2-4e53-83b3-09a9dff3c5ce None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.737079 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b379e30-d3c2-4e53-83b3-09a9dff3c5ce None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.800700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535c195-db90-48ec-9c7d-6f7d7f497d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.801450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535c195-db90-48ec-9c7d-6f7d7f497d9d admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.801850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535c195-db90-48ec-9c7d-6f7d7f497d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.802005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535c195-db90-48ec-9c7d-6f7d7f497d9d admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.802780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535c195-db90-48ec-9c7d-6f7d7f497d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.804749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535c195-db90-48ec-9c7d-6f7d7f497d9d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.829233 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1272/2558] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:35 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:35.833269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca8e33-3c4c-4ea6-8a1d-4ae808ba91d5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.844977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca8e33-3c4c-4ea6-8a1d-4ae808ba91d5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.850314 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414727fb-7edd-4767-a0e7-cbd8d47fc3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.850937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414727fb-7edd-4767-a0e7-cbd8d47fc3ea admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.851219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414727fb-7edd-4767-a0e7-cbd8d47fc3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.851492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414727fb-7edd-4767-a0e7-cbd8d47fc3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.852236 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414727fb-7edd-4767-a0e7-cbd8d47fc3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.854283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414727fb-7edd-4767-a0e7-cbd8d47fc3ea admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.866394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1287/2559] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:35.870303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535c195-db90-48ec-9c7d-6f7d7f497d9d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.877949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:35.882282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535c195-db90-48ec-9c7d-6f7d7f497d9d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.888874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84fc80-a512-4e15-8e30-aba3edc08f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.889483 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84fc80-a512-4e15-8e30-aba3edc08f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.889822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84fc80-a512-4e15-8e30-aba3edc08f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.890095 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84fc80-a512-4e15-8e30-aba3edc08f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.890846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84fc80-a512-4e15-8e30-aba3edc08f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.892511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b84fc80-a512-4e15-8e30-aba3edc08f9b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.902894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1273/2560] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:35.907069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414727fb-7edd-4767-a0e7-cbd8d47fc3ea admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:35.916891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414727fb-7edd-4767-a0e7-cbd8d47fc3ea admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:35.922082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bd5d0-095b-467b-b6cf-d9880f522b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:35.922746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bd5d0-095b-467b-b6cf-d9880f522b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.923019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bd5d0-095b-467b-b6cf-d9880f522b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.923404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bd5d0-095b-467b-b6cf-d9880f522b23 admin admin] PATH_INFO: `/v3/projects/a6e957a0285b4b3fa723173bec105e34/users/2f26a9f555a24887a2db07ee96178747/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.943144 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bd5d0-095b-467b-b6cf-d9880f522b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e957a0285b4b3fa723173bec105e34, user_id=2f26a9f555a24887a2db07ee96178747, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:35.946313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bd5d0-095b-467b-b6cf-d9880f522b23 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:35.959505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1288/2561] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:35 2022] PUT /identity/v3/projects/a6e957a0285b4b3fa723173bec105e34/users/2f26a9f555a24887a2db07ee96178747/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:35.971235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f157cc9-5b8a-4cf0-bd79-014c97c0e2c7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:35.971664 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f157cc9-5b8a-4cf0-bd79-014c97c0e2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:35.971786 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f157cc9-5b8a-4cf0-bd79-014c97c0e2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:35.999775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4f157cc9-5b8a-4cf0-bd79-014c97c0e2c7 None None] MFA Rules not processed for user `2f26a9f555a24887a2db07ee96178747`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:36.001054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4f157cc9-5b8a-4cf0-bd79-014c97c0e2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:36.065073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1274/2562] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:36.069630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bd5d0-095b-467b-b6cf-d9880f522b23 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:36.137782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bd5d0-095b-467b-b6cf-d9880f522b23 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:36.142965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c5f31-d571-4a27-afc4-f5969dd0522c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:36.143711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c5f31-d571-4a27-afc4-f5969dd0522c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.144737 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c5f31-d571-4a27-afc4-f5969dd0522c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.144998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c5f31-d571-4a27-afc4-f5969dd0522c admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.145738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c5f31-d571-4a27-afc4-f5969dd0522c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:36.147924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c5f31-d571-4a27-afc4-f5969dd0522c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:36.176317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1289/2563] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:36 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:36.180516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f157cc9-5b8a-4cf0-bd79-014c97c0e2c7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:36.191183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f157cc9-5b8a-4cf0-bd79-014c97c0e2c7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:36.259054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4159c-3e66-4e3a-b629-1552f5512052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:36.259706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4159c-3e66-4e3a-b629-1552f5512052 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.259985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4159c-3e66-4e3a-b629-1552f5512052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.260300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4159c-3e66-4e3a-b629-1552f5512052 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.261181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4159c-3e66-4e3a-b629-1552f5512052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:36.263083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4159c-3e66-4e3a-b629-1552f5512052 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:36.285185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1275/2564] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:36 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:36.289129 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c5f31-d571-4a27-afc4-f5969dd0522c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:36.299998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c5f31-d571-4a27-afc4-f5969dd0522c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:36.305011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66b61e-f312-4b97-9d3a-5e97733a4db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:36.305629 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b61e-f312-4b97-9d3a-5e97733a4db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.305911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b61e-f312-4b97-9d3a-5e97733a4db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.306184 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66b61e-f312-4b97-9d3a-5e97733a4db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.306883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66b61e-f312-4b97-9d3a-5e97733a4db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:36.308560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66b61e-f312-4b97-9d3a-5e97733a4db0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:36.319471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1290/2565] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:36.323740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4159c-3e66-4e3a-b629-1552f5512052 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:36.334066 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4159c-3e66-4e3a-b629-1552f5512052 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:36.338797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3250e0-5cb8-487b-87e1-afdf098f7f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:36.339461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3250e0-5cb8-487b-87e1-afdf098f7f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.339745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3250e0-5cb8-487b-87e1-afdf098f7f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.340019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3250e0-5cb8-487b-87e1-afdf098f7f1b admin admin] PATH_INFO: `/v3/projects/217d7cb6af8846f09a6e535d4057a02e/users/58653b9038a5433c89092f607a11029b/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.358478 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3250e0-5cb8-487b-87e1-afdf098f7f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=217d7cb6af8846f09a6e535d4057a02e, user_id=58653b9038a5433c89092f607a11029b, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:36.361342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3250e0-5cb8-487b-87e1-afdf098f7f1b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:36.375098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1276/2566] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:36 2022] PUT /identity/v3/projects/217d7cb6af8846f09a6e535d4057a02e/users/58653b9038a5433c89092f607a11029b/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:36.379073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66b61e-f312-4b97-9d3a-5e97733a4db0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:36.390703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66b61e-f312-4b97-9d3a-5e97733a4db0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:36.453920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05fe59b-20c5-4d9f-8176-140b1307e8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:36.454691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe59b-20c5-4d9f-8176-140b1307e8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.455039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe59b-20c5-4d9f-8176-140b1307e8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.455386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05fe59b-20c5-4d9f-8176-140b1307e8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.456246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fe59b-20c5-4d9f-8176-140b1307e8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:36.458078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05fe59b-20c5-4d9f-8176-140b1307e8e2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:36.470812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1291/2567] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:36.474816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3250e0-5cb8-487b-87e1-afdf098f7f1b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:36.486147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3250e0-5cb8-487b-87e1-afdf098f7f1b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:36.491806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b41ece-cd35-4248-b58f-f5d815e50520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:36.492500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b41ece-cd35-4248-b58f-f5d815e50520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.492790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b41ece-cd35-4248-b58f-f5d815e50520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.493081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b41ece-cd35-4248-b58f-f5d815e50520 admin admin] PATH_INFO: `/v3/projects/217d7cb6af8846f09a6e535d4057a02e/users/58653b9038a5433c89092f607a11029b/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.495128 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b41ece-cd35-4248-b58f-f5d815e50520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217d7cb6af8846f09a6e535d4057a02e, user_id=58653b9038a5433c89092f607a11029b, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:36.497956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b41ece-cd35-4248-b58f-f5d815e50520 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:36.514215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1277/2568] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:36 2022] PUT /identity/v3/projects/217d7cb6af8846f09a6e535d4057a02e/users/58653b9038a5433c89092f607a11029b/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:36.525956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43fd10-8711-4856-a5d3-d06e83550ca1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.526329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43fd10-8711-4856-a5d3-d06e83550ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.526609 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43fd10-8711-4856-a5d3-d06e83550ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.559604 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:36.569615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ed43fd10-8711-4856-a5d3-d06e83550ca1 None None] MFA Rules not processed for user `58653b9038a5433c89092f607a11029b`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:36.571140 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ed43fd10-8711-4856-a5d3-d06e83550ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:36.674376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1292/2569] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:36.688126 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b41ece-cd35-4248-b58f-f5d815e50520 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:36.689966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-29b41ece-cd35-4248-b58f-f5d815e50520 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:36.733057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:36.753905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b41ece-cd35-4248-b58f-f5d815e50520 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:36.757769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f3dff-7498-43fb-97ea-13560ccbad6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:36.758402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f3dff-7498-43fb-97ea-13560ccbad6b service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.758677 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f3dff-7498-43fb-97ea-13560ccbad6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.759035 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f3dff-7498-43fb-97ea-13560ccbad6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.769298 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f3dff-7498-43fb-97ea-13560ccbad6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:36.770966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f3dff-7498-43fb-97ea-13560ccbad6b service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:36.781414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1278/2570] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:36.833745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43fd10-8711-4856-a5d3-d06e83550ca1 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:36.835233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ed43fd10-8711-4856-a5d3-d06e83550ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:36.847934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43fd10-8711-4856-a5d3-d06e83550ca1 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:36.852456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848406e-9296-45b6-9e6b-a58eca6e3b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:36.853092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848406e-9296-45b6-9e6b-a58eca6e3b59 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.853366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848406e-9296-45b6-9e6b-a58eca6e3b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.853666 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848406e-9296-45b6-9e6b-a58eca6e3b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.898226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f3dff-7498-43fb-97ea-13560ccbad6b service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:36.899616 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7f1f3dff-7498-43fb-97ea-13560ccbad6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:36.916845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848406e-9296-45b6-9e6b-a58eca6e3b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:36.918303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f848406e-9296-45b6-9e6b-a58eca6e3b59 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:36.929482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1293/2571] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:36.976819 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f3dff-7498-43fb-97ea-13560ccbad6b service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:36.981783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14e348-9c87-4e38-a043-3566321c8e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:36.983073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14e348-9c87-4e38-a043-3566321c8e39 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:36.983494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14e348-9c87-4e38-a043-3566321c8e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:36.984082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14e348-9c87-4e38-a043-3566321c8e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:36.987596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-2a14e348-9c87-4e38-a043-3566321c8e39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:37.082608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14e348-9c87-4e38-a043-3566321c8e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:37.084248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14e348-9c87-4e38-a043-3566321c8e39 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:37.095373 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1279/2572] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:50:39.908927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848406e-9296-45b6-9e6b-a58eca6e3b59 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:39.973927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f848406e-9296-45b6-9e6b-a58eca6e3b59 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:39.978560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:39.979238 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:39.979519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:39.979794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] PATH_INFO: `/v3/users/5d59f3c0e39a46cb91ed45b81fc8a762` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:39.980986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d59f3c0e39a46cb91ed45b81fc8a762)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:39.982932 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:40.023484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:40.033409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d59f3c0e39a46cb91ed45b81fc8a762'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.046095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d59f3c0e39a46cb91ed45b81fc8a762'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.053359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d59f3c0e39a46cb91ed45b81fc8a762'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.054203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d59f3c0e39a46cb91ed45b81fc8a762'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.054945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d59f3c0e39a46cb91ed45b81fc8a762'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.068943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1294/2573] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:39 2022] DELETE /identity/v3/users/5d59f3c0e39a46cb91ed45b81fc8a762 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:40.073732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c7887-4e4c-4a04-b4d0-543c843d7c70 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:40.074240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c7887-4e4c-4a04-b4d0-543c843d7c70 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:40.074362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5c7887-4e4c-4a04-b4d0-543c843d7c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:40.095279 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7b5c7887-4e4c-4a04-b4d0-543c843d7c70 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:40.096446 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b5c7887-4e4c-4a04-b4d0-543c843d7c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:40.156956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1280/2574] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:40.166805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:40.168221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:40.229296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21ef5-e19b-4864-83df-a5a91e5a6788 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:40.233626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28728ed8-4267-4267-90aa-03acddf0b869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:40.234246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28728ed8-4267-4267-90aa-03acddf0b869 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:40.234531 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28728ed8-4267-4267-90aa-03acddf0b869 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:40.234806 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28728ed8-4267-4267-90aa-03acddf0b869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:40.244270 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28728ed8-4267-4267-90aa-03acddf0b869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:40.245839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28728ed8-4267-4267-90aa-03acddf0b869 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:40.256353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1295/2575] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:40.520456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c7887-4e4c-4a04-b4d0-543c843d7c70 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:40.522142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b5c7887-4e4c-4a04-b4d0-543c843d7c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:40.538978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5c7887-4e4c-4a04-b4d0-543c843d7c70 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:40.543949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:40.544555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:40.544837 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:40.545109 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] PATH_INFO: `/v3/projects/e756242428f745a59767270e77b61a3c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:40.546269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e756242428f745a59767270e77b61a3c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:40.548342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:40.573563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:40.597146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e756242428f745a59767270e77b61a3c', 'request_id': 'req-4ff2922f-7540-4706-888a-d94b0b99a05b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.604779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e756242428f745a59767270e77b61a3c', 'request_id': 'req-4ff2922f-7540-4706-888a-d94b0b99a05b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.610857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e756242428f745a59767270e77b61a3c', 'request_id': 'req-4ff2922f-7540-4706-888a-d94b0b99a05b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.620901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] The token cache is being invalidate because project e756242428f745a59767270e77b61a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:40.621183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.621792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.623772 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1281/2576] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:40 2022] DELETE /identity/v3/projects/e756242428f745a59767270e77b61a3c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:40.627777 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28728ed8-4267-4267-90aa-03acddf0b869 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:40.637663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28728ed8-4267-4267-90aa-03acddf0b869 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:40.694103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:40.694732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:40.695009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:40.695276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] PATH_INFO: `/v3/users/2f26a9f555a24887a2db07ee96178747` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:40.696512 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f26a9f555a24887a2db07ee96178747)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:40.698427 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:40.742544 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f26a9f555a24887a2db07ee96178747'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.749937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:40.755338 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f26a9f555a24887a2db07ee96178747'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.762927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f26a9f555a24887a2db07ee96178747'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.763600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f26a9f555a24887a2db07ee96178747'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.764243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f26a9f555a24887a2db07ee96178747'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.782060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1296/2577] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:40 2022] DELETE /identity/v3/users/2f26a9f555a24887a2db07ee96178747 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:40.872857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:40.874363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:40.937761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff2922f-7540-4706-888a-d94b0b99a05b admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:40.989743 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3450a58-7fb6-4269-9feb-6de2e5b84858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:40.990658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3450a58-7fb6-4269-9feb-6de2e5b84858 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:40.990658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3450a58-7fb6-4269-9feb-6de2e5b84858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:40.990909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3450a58-7fb6-4269-9feb-6de2e5b84858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:40.992693 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a3450a58-7fb6-4269-9feb-6de2e5b84858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:41.057984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3450a58-7fb6-4269-9feb-6de2e5b84858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:41.059621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3450a58-7fb6-4269-9feb-6de2e5b84858 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:41.072344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1282/2578] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:41.078957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:41.080735 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:41.094616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b737e-b795-4941-81b8-a5e5c5f3c8a1 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:41.099269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:41.099911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:41.100211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:41.100488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] PATH_INFO: `/v3/projects/a6e957a0285b4b3fa723173bec105e34` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:41.101641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e957a0285b4b3fa723173bec105e34)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:41.103564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:41.159775 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e957a0285b4b3fa723173bec105e34', 'request_id': 'req-526b18ee-d2bb-4cc5-9237-09f7af2c92be'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.166186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e957a0285b4b3fa723173bec105e34', 'request_id': 'req-526b18ee-d2bb-4cc5-9237-09f7af2c92be'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.174889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e957a0285b4b3fa723173bec105e34', 'request_id': 'req-526b18ee-d2bb-4cc5-9237-09f7af2c92be'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.188064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] The token cache is being invalidate because project a6e957a0285b4b3fa723173bec105e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:41.188385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.189028 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.190937 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1297/2579] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:41 2022] DELETE /identity/v3/projects/a6e957a0285b4b3fa723173bec105e34 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:41.194571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3450a58-7fb6-4269-9feb-6de2e5b84858 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:41.204811 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3450a58-7fb6-4269-9feb-6de2e5b84858 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:41.217627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:41.265335 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:41.266073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:41.266385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:41.266652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] PATH_INFO: `/v3/users/58653b9038a5433c89092f607a11029b` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:41.268007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58653b9038a5433c89092f607a11029b)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:41.269976 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:41.317551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58653b9038a5433c89092f607a11029b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.324734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58653b9038a5433c89092f607a11029b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.333276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58653b9038a5433c89092f607a11029b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.334104 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58653b9038a5433c89092f607a11029b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.334718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ab424c77-889b-4c76-949b-2f492759d8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58653b9038a5433c89092f607a11029b'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.357862 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1283/2580] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:41 2022] DELETE /identity/v3/users/58653b9038a5433c89092f607a11029b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:41.810641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:41.812960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:41.829970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b18ee-d2bb-4cc5-9237-09f7af2c92be admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:41.891602 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:41.892442 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:41.892747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:41.893029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] PATH_INFO: `/v3/projects/217d7cb6af8846f09a6e535d4057a02e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:41.894215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217d7cb6af8846f09a6e535d4057a02e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:41.896122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:41.945214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217d7cb6af8846f09a6e535d4057a02e', 'request_id': 'req-86033383-fba6-47ad-98fd-e4111362ffd9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.951888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217d7cb6af8846f09a6e535d4057a02e', 'request_id': 'req-86033383-fba6-47ad-98fd-e4111362ffd9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.959676 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217d7cb6af8846f09a6e535d4057a02e', 'request_id': 'req-86033383-fba6-47ad-98fd-e4111362ffd9'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.961224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:41.976739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] The token cache is being invalidate because project 217d7cb6af8846f09a6e535d4057a02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:41.977030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.977683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-86033383-fba6-47ad-98fd-e4111362ffd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:41.979209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1298/2581] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:41 2022] DELETE /identity/v3/projects/217d7cb6af8846f09a6e535d4057a02e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:41.985171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae176-1fa3-418d-9e08-fa9cb86766c5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:41.985528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae176-1fa3-418d-9e08-fa9cb86766c5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:41.985870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ae176-1fa3-418d-9e08-fa9cb86766c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.006391 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-012ae176-1fa3-418d-9e08-fa9cb86766c5 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:42.007710 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-012ae176-1fa3-418d-9e08-fa9cb86766c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:42.072347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1284/2582] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:42.082982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b0e5f-b41c-4d10-9e17-537b624d3d2f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.083850 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b0e5f-b41c-4d10-9e17-537b624d3d2f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.084458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b0e5f-b41c-4d10-9e17-537b624d3d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.106011 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-785b0e5f-b41c-4d10-9e17-537b624d3d2f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:42.107812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-785b0e5f-b41c-4d10-9e17-537b624d3d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:42.116623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1299/2583] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:42.120942 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae176-1fa3-418d-9e08-fa9cb86766c5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.131556 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ae176-1fa3-418d-9e08-fa9cb86766c5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.136635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b59c0-b08d-4d1d-ad4f-a133292679f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.137258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b59c0-b08d-4d1d-ad4f-a133292679f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.137698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b59c0-b08d-4d1d-ad4f-a133292679f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.138190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b59c0-b08d-4d1d-ad4f-a133292679f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.139123 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b59c0-b08d-4d1d-ad4f-a133292679f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:50:42.139599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b59c0-b08d-4d1d-ad4f-a133292679f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.142189 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b59c0-b08d-4d1d-ad4f-a133292679f0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.157894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1285/2584] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:50:42.162992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b0e5f-b41c-4d10-9e17-537b624d3d2f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.174336 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b0e5f-b41c-4d10-9e17-537b624d3d2f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.179503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b741044-ffca-4057-9bc6-fd465eb9c8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.180153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b741044-ffca-4057-9bc6-fd465eb9c8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.180433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b741044-ffca-4057-9bc6-fd465eb9c8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.180710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b741044-ffca-4057-9bc6-fd465eb9c8e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.181530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b741044-ffca-4057-9bc6-fd465eb9c8e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.183556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b741044-ffca-4057-9bc6-fd465eb9c8e0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.216300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1300/2585] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:42 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:42.218709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b59c0-b08d-4d1d-ad4f-a133292679f0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.229000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b59c0-b08d-4d1d-ad4f-a133292679f0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.251346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:42.296480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7d222-9aa0-4ce7-9379-7fe462b71ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.297093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7d222-9aa0-4ce7-9379-7fe462b71ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.297371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7d222-9aa0-4ce7-9379-7fe462b71ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.297639 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7d222-9aa0-4ce7-9379-7fe462b71ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.298304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7d222-9aa0-4ce7-9379-7fe462b71ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.300266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7d222-9aa0-4ce7-9379-7fe462b71ce6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.326605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1286/2586] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:42 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:42.328062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b741044-ffca-4057-9bc6-fd465eb9c8e0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.338706 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b741044-ffca-4057-9bc6-fd465eb9c8e0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.343950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148182-57ca-4cb2-a094-7c7cade6b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.344655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148182-57ca-4cb2-a094-7c7cade6b70d admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.345005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148182-57ca-4cb2-a094-7c7cade6b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.345383 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148182-57ca-4cb2-a094-7c7cade6b70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.346169 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148182-57ca-4cb2-a094-7c7cade6b70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.347860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148182-57ca-4cb2-a094-7c7cade6b70d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.359895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1301/2587] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:42.364325 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7d222-9aa0-4ce7-9379-7fe462b71ce6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.378272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7d222-9aa0-4ce7-9379-7fe462b71ce6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.383124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07e1c1-9b1b-41cb-a14d-4fd4883532d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.383739 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07e1c1-9b1b-41cb-a14d-4fd4883532d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.384023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07e1c1-9b1b-41cb-a14d-4fd4883532d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.384326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07e1c1-9b1b-41cb-a14d-4fd4883532d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.385031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07e1c1-9b1b-41cb-a14d-4fd4883532d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.386629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07e1c1-9b1b-41cb-a14d-4fd4883532d2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.400115 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1287/2588] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:42.405175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148182-57ca-4cb2-a094-7c7cade6b70d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.415143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148182-57ca-4cb2-a094-7c7cade6b70d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.419734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57ec71-91f4-4c5d-b470-a565ecbeb119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.420503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ec71-91f4-4c5d-b470-a565ecbeb119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.420849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ec71-91f4-4c5d-b470-a565ecbeb119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.421211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57ec71-91f4-4c5d-b470-a565ecbeb119 admin admin] PATH_INFO: `/v3/projects/1172a031a8824545bca07ddfc0e3ce3e/users/90274d2d9d7344a0b1fff8c86b1e33ad/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.436771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57ec71-91f4-4c5d-b470-a565ecbeb119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1172a031a8824545bca07ddfc0e3ce3e, user_id=90274d2d9d7344a0b1fff8c86b1e33ad, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.439548 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57ec71-91f4-4c5d-b470-a565ecbeb119 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.454445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1302/2589] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:42 2022] PUT /identity/v3/projects/1172a031a8824545bca07ddfc0e3ce3e/users/90274d2d9d7344a0b1fff8c86b1e33ad/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:42.467905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3847399-2341-4438-bea6-7fab78f9ae36 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.468288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3847399-2341-4438-bea6-7fab78f9ae36 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.468585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3847399-2341-4438-bea6-7fab78f9ae36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.498402 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e3847399-2341-4438-bea6-7fab78f9ae36 None None] MFA Rules not processed for user `90274d2d9d7344a0b1fff8c86b1e33ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:42.499668 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e3847399-2341-4438-bea6-7fab78f9ae36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:42.567974 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1288/2590] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:42.572541 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57ec71-91f4-4c5d-b470-a565ecbeb119 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.636753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57ec71-91f4-4c5d-b470-a565ecbeb119 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.643528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3591-149a-4720-92b4-fdb837f98807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.644174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3591-149a-4720-92b4-fdb837f98807 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.644459 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3591-149a-4720-92b4-fdb837f98807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.644731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf3591-149a-4720-92b4-fdb837f98807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.645413 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf3591-149a-4720-92b4-fdb837f98807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.647594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf3591-149a-4720-92b4-fdb837f98807 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.678645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1303/2591] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:42 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:42.679860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3847399-2341-4438-bea6-7fab78f9ae36 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.692534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3847399-2341-4438-bea6-7fab78f9ae36 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.756551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b933d0-857a-4107-b536-a04014c9df03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.757087 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b933d0-857a-4107-b536-a04014c9df03 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.757371 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b933d0-857a-4107-b536-a04014c9df03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.757644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b933d0-857a-4107-b536-a04014c9df03 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.758308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b933d0-857a-4107-b536-a04014c9df03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.760736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b933d0-857a-4107-b536-a04014c9df03 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.787306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1289/2592] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:42 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:42.788716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3591-149a-4720-92b4-fdb837f98807 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.799147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf3591-149a-4720-92b4-fdb837f98807 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.803926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52660c-d6aa-4f1d-942d-ed23028d4ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.804575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52660c-d6aa-4f1d-942d-ed23028d4ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.804856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52660c-d6aa-4f1d-942d-ed23028d4ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.805130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52660c-d6aa-4f1d-942d-ed23028d4ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.805827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52660c-d6aa-4f1d-942d-ed23028d4ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.807432 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52660c-d6aa-4f1d-942d-ed23028d4ee2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.818756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1304/2593] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:42.822894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b933d0-857a-4107-b536-a04014c9df03 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.833316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b933d0-857a-4107-b536-a04014c9df03 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.840848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71822b53-46a1-4f64-98e6-0bb5cf7d35a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.840848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71822b53-46a1-4f64-98e6-0bb5cf7d35a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.840848 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71822b53-46a1-4f64-98e6-0bb5cf7d35a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.845769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71822b53-46a1-4f64-98e6-0bb5cf7d35a4 admin admin] PATH_INFO: `/v3/projects/cf4698933aef4ebdb123de324662a209/users/f4f6ef925e96488c8986ea5b2e1787a7/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.863684 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71822b53-46a1-4f64-98e6-0bb5cf7d35a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4698933aef4ebdb123de324662a209, user_id=f4f6ef925e96488c8986ea5b2e1787a7, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.866360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71822b53-46a1-4f64-98e6-0bb5cf7d35a4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.876644 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:42.885045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1290/2594] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:42 2022] PUT /identity/v3/projects/cf4698933aef4ebdb123de324662a209/users/f4f6ef925e96488c8986ea5b2e1787a7/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:42.889499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52660c-d6aa-4f1d-942d-ed23028d4ee2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.900218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52660c-d6aa-4f1d-942d-ed23028d4ee2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:42.964668 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b1580-1e14-4baf-9ad1-553486acf957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:42.965300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b1580-1e14-4baf-9ad1-553486acf957 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:42.965581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b1580-1e14-4baf-9ad1-553486acf957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:42.965856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b1580-1e14-4baf-9ad1-553486acf957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:42.967106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b1580-1e14-4baf-9ad1-553486acf957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:42.968893 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b1580-1e14-4baf-9ad1-553486acf957 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:42.970649 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:42.986922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1305/2595] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:42.987761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71822b53-46a1-4f64-98e6-0bb5cf7d35a4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:42.998590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71822b53-46a1-4f64-98e6-0bb5cf7d35a4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:43.004152 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dd492-4eef-45ae-a747-d01b6604eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:43.004890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dd492-4eef-45ae-a747-d01b6604eb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:43.005176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dd492-4eef-45ae-a747-d01b6604eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:43.005462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dd492-4eef-45ae-a747-d01b6604eb1d admin admin] PATH_INFO: `/v3/projects/cf4698933aef4ebdb123de324662a209/users/f4f6ef925e96488c8986ea5b2e1787a7/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:43.007481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dd492-4eef-45ae-a747-d01b6604eb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf4698933aef4ebdb123de324662a209, user_id=f4f6ef925e96488c8986ea5b2e1787a7, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:43.010092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4dd492-4eef-45ae-a747-d01b6604eb1d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:43.022251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1291/2596] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:42 2022] PUT /identity/v3/projects/cf4698933aef4ebdb123de324662a209/users/f4f6ef925e96488c8986ea5b2e1787a7/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:43.032917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8077e03-22ed-4e75-9b81-5a1d4a4c03b9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:43.033348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8077e03-22ed-4e75-9b81-5a1d4a4c03b9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:43.033725 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8077e03-22ed-4e75-9b81-5a1d4a4c03b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:43.069588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-a8077e03-22ed-4e75-9b81-5a1d4a4c03b9 None None] MFA Rules not processed for user `f4f6ef925e96488c8986ea5b2e1787a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:43.071026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a8077e03-22ed-4e75-9b81-5a1d4a4c03b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:43.166269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1306/2597] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:43.181997 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dd492-4eef-45ae-a747-d01b6604eb1d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:43.184030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4e4dd492-4eef-45ae-a747-d01b6604eb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:43.245432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dd492-4eef-45ae-a747-d01b6604eb1d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:43.249606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02760e15-7f9c-4dd7-9511-d1fcafde2ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:43.250300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02760e15-7f9c-4dd7-9511-d1fcafde2ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:43.250659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02760e15-7f9c-4dd7-9511-d1fcafde2ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:43.251005 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02760e15-7f9c-4dd7-9511-d1fcafde2ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:43.261990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02760e15-7f9c-4dd7-9511-d1fcafde2ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:43.263576 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02760e15-7f9c-4dd7-9511-d1fcafde2ee2 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:43.274410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1292/2598] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:43.874085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8077e03-22ed-4e75-9b81-5a1d4a4c03b9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:43.947273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8077e03-22ed-4e75-9b81-5a1d4a4c03b9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:43.952771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:43.953583 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:43.953870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:43.954143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] PATH_INFO: `/v3/users/90274d2d9d7344a0b1fff8c86b1e33ad` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:43.955371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90274d2d9d7344a0b1fff8c86b1e33ad)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:43.957950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:44.024058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90274d2d9d7344a0b1fff8c86b1e33ad'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.038694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90274d2d9d7344a0b1fff8c86b1e33ad'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.046672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90274d2d9d7344a0b1fff8c86b1e33ad'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.047575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90274d2d9d7344a0b1fff8c86b1e33ad'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.048292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90274d2d9d7344a0b1fff8c86b1e33ad'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.059969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:44.066562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1307/2599] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:43 2022] DELETE /identity/v3/users/90274d2d9d7344a0b1fff8c86b1e33ad => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:44.071326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdad209-b1be-40c5-999c-f7000ab82acd None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:44.071626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdad209-b1be-40c5-999c-f7000ab82acd None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:44.071898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdad209-b1be-40c5-999c-f7000ab82acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:44.094054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5bdad209-b1be-40c5-999c-f7000ab82acd None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:44.095503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5bdad209-b1be-40c5-999c-f7000ab82acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:44.160030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1293/2600] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:44.170808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:44.172948 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:44.233034 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d95b5-a26f-4433-8463-b56a15eef55b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:44.236885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca1f4-e799-483b-b3e8-70101d366dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:44.237522 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca1f4-e799-483b-b3e8-70101d366dbe service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:44.237803 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca1f4-e799-483b-b3e8-70101d366dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:44.238078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca1f4-e799-483b-b3e8-70101d366dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:44.252797 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca1f4-e799-483b-b3e8-70101d366dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:44.254295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca1f4-e799-483b-b3e8-70101d366dbe service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:44.266237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1308/2601] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:44.801450 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdad209-b1be-40c5-999c-f7000ab82acd None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:44.803821 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5bdad209-b1be-40c5-999c-f7000ab82acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:44.816232 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdad209-b1be-40c5-999c-f7000ab82acd None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:44.820967 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:44.821564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:44.821844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:44.822299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] PATH_INFO: `/v3/projects/1172a031a8824545bca07ddfc0e3ce3e` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:44.823480 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1172a031a8824545bca07ddfc0e3ce3e)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:44.825429 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:44.878680 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1172a031a8824545bca07ddfc0e3ce3e', 'request_id': 'req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.886537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1172a031a8824545bca07ddfc0e3ce3e', 'request_id': 'req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.893950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1172a031a8824545bca07ddfc0e3ce3e', 'request_id': 'req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.906312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] The token cache is being invalidate because project 1172a031a8824545bca07ddfc0e3ce3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:44.906606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.907291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:44.908990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1294/2602] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:44 2022] DELETE /identity/v3/projects/1172a031a8824545bca07ddfc0e3ce3e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:44.913243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca1f4-e799-483b-b3e8-70101d366dbe service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:44.924974 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca1f4-e799-483b-b3e8-70101d366dbe service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:44.943934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:44.945951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:44.961781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:44.992199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:44.992967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:44.993317 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:44.993597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] PATH_INFO: `/v3/users/f4f6ef925e96488c8986ea5b2e1787a7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:44.994762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f6ef925e96488c8986ea5b2e1787a7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:44.996713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.025726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fe1ba-2f13-4b70-9289-ad1e2c22ee42 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.031732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.032410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.033192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.033484 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] PATH_INFO: `/v3/users/e477f5953a534355b29c071086846ff6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.043324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f6ef925e96488c8986ea5b2e1787a7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.059123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f6ef925e96488c8986ea5b2e1787a7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.068226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f6ef925e96488c8986ea5b2e1787a7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.069029 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f6ef925e96488c8986ea5b2e1787a7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.069640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f6ef925e96488c8986ea5b2e1787a7'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.085171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1309/2603] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:44 2022] DELETE /identity/v3/users/f4f6ef925e96488c8986ea5b2e1787a7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:45.185630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e477f5953a534355b29c071086846ff6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.188423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.239261 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e477f5953a534355b29c071086846ff6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.252027 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e477f5953a534355b29c071086846ff6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.260784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e477f5953a534355b29c071086846ff6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.261461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e477f5953a534355b29c071086846ff6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.262086 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e477f5953a534355b29c071086846ff6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.282584 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1295/2604] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:44 2022] DELETE /identity/v3/users/e477f5953a534355b29c071086846ff6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:45.388984 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:45.390523 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:45.429686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:45.465788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:45.468232 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:45.481190 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba43250-aca1-40de-82e3-9712c395178d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.541365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.542009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.542290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.542564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] PATH_INFO: `/v3/projects/cf4698933aef4ebdb123de324662a209` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.543718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf4698933aef4ebdb123de324662a209)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.546219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.551122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad191f-d0fa-4128-851c-45f62a8b21f7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.555799 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.556486 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.556768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.557041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] PATH_INFO: `/v3/projects/c63bab062a6e4225a462ac0265535d16` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.567607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63bab062a6e4225a462ac0265535d16)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.569590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.581055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:45.593250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf4698933aef4ebdb123de324662a209', 'request_id': 'req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.600929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf4698933aef4ebdb123de324662a209', 'request_id': 'req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.608927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf4698933aef4ebdb123de324662a209', 'request_id': 'req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.617587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63bab062a6e4225a462ac0265535d16', 'request_id': 'req-8366319c-a827-49ae-91a2-80983a90f692'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.619214 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] The token cache is being invalidate because project cf4698933aef4ebdb123de324662a209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:45.619521 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.620176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-647fb3cd-7486-43eb-b03e-2ac43b5e4cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.621886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1310/2605] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:45 2022] DELETE /identity/v3/projects/cf4698933aef4ebdb123de324662a209 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:45.625001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63bab062a6e4225a462ac0265535d16', 'request_id': 'req-8366319c-a827-49ae-91a2-80983a90f692'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.626815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928b63a-65d9-4f9b-9674-d8ec9bfa802d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.627105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928b63a-65d9-4f9b-9674-d8ec9bfa802d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.627384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928b63a-65d9-4f9b-9674-d8ec9bfa802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.632431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63bab062a6e4225a462ac0265535d16', 'request_id': 'req-8366319c-a827-49ae-91a2-80983a90f692'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.644409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] The token cache is being invalidate because project c63bab062a6e4225a462ac0265535d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:45.644700 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.645382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8366319c-a827-49ae-91a2-80983a90f692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:45.647184 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1296/2606] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:45 2022] DELETE /identity/v3/projects/c63bab062a6e4225a462ac0265535d16 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:45.649682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-6928b63a-65d9-4f9b-9674-d8ec9bfa802d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:45.650875 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-6928b63a-65d9-4f9b-9674-d8ec9bfa802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:45.652075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b4267-5a0a-40b1-9e0a-32cd5a5bd6b1 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.652466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b4267-5a0a-40b1-9e0a-32cd5a5bd6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.652751 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b4267-5a0a-40b1-9e0a-32cd5a5bd6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.673839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-0d9b4267-5a0a-40b1-9e0a-32cd5a5bd6b1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:45.675168 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-0d9b4267-5a0a-40b1-9e0a-32cd5a5bd6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:45.704691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:45.723528 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1311/2607] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:45.725067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7e18-0538-4b75-b70a-482c83f94626 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.725348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7e18-0538-4b75-b70a-482c83f94626 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.725647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f7e18-0538-4b75-b70a-482c83f94626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.736187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1297/2608] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:45.746551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887abea-ae1d-4db8-a830-879d3509a2ad None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.746834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887abea-ae1d-4db8-a830-879d3509a2ad None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.746960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d36f7e18-0538-4b75-b70a-482c83f94626 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:45.747129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887abea-ae1d-4db8-a830-879d3509a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.748783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d36f7e18-0538-4b75-b70a-482c83f94626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:45.756990 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1312/2609] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:45.760872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7e18-0538-4b75-b70a-482c83f94626 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:45.766575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c887abea-ae1d-4db8-a830-879d3509a2ad None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:45.767761 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c887abea-ae1d-4db8-a830-879d3509a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:45.770524 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f7e18-0538-4b75-b70a-482c83f94626 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.775256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a18483-9536-492f-af82-d6b29946648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.775852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a18483-9536-492f-af82-d6b29946648e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.779587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1298/2610] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:45.779720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a18483-9536-492f-af82-d6b29946648e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.779720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a18483-9536-492f-af82-d6b29946648e admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.779720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a18483-9536-492f-af82-d6b29946648e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:50:45.779720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a18483-9536-492f-af82-d6b29946648e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.779720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a18483-9536-492f-af82-d6b29946648e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.780422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887abea-ae1d-4db8-a830-879d3509a2ad None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:45.789263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887abea-ae1d-4db8-a830-879d3509a2ad None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.793025 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1313/2611] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:50:45.793875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15b070-4927-453a-93cd-8cde3b295154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.795034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b070-4927-453a-93cd-8cde3b295154 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.795315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b070-4927-453a-93cd-8cde3b295154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.795587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15b070-4927-453a-93cd-8cde3b295154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.796344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15b070-4927-453a-93cd-8cde3b295154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:50:45.796649 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15b070-4927-453a-93cd-8cde3b295154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.798574 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c15b070-4927-453a-93cd-8cde3b295154 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.799851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a18483-9536-492f-af82-d6b29946648e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:45.810905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1299/2612] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:50:45.813198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a18483-9536-492f-af82-d6b29946648e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.815327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15b070-4927-453a-93cd-8cde3b295154 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:45.818099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fefd32-3619-4add-a697-7950148561b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.818716 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fefd32-3619-4add-a697-7950148561b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.818997 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fefd32-3619-4add-a697-7950148561b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.819268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fefd32-3619-4add-a697-7950148561b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.819931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fefd32-3619-4add-a697-7950148561b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.822123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fefd32-3619-4add-a697-7950148561b9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.826212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15b070-4927-453a-93cd-8cde3b295154 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.832430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480696-0e10-4f5b-963a-183eedbc1087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.833382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480696-0e10-4f5b-963a-183eedbc1087 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.833669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480696-0e10-4f5b-963a-183eedbc1087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.833950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc480696-0e10-4f5b-963a-183eedbc1087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.835073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc480696-0e10-4f5b-963a-183eedbc1087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.837366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc480696-0e10-4f5b-963a-183eedbc1087 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.849804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1314/2613] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:45 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:45.854177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fefd32-3619-4add-a697-7950148561b9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:45.870276 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1300/2614] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:45 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:45.874958 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480696-0e10-4f5b-963a-183eedbc1087 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:45.916369 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fefd32-3619-4add-a697-7950148561b9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.936908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc480696-0e10-4f5b-963a-183eedbc1087 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.941463 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a54806-05e7-4110-b1dd-b7286af370bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.942065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a54806-05e7-4110-b1dd-b7286af370bf admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.942340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a54806-05e7-4110-b1dd-b7286af370bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.942611 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a54806-05e7-4110-b1dd-b7286af370bf admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.943262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a54806-05e7-4110-b1dd-b7286af370bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.945281 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a54806-05e7-4110-b1dd-b7286af370bf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.953061 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:45.973110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1301/2615] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:45 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:45.973812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a54806-05e7-4110-b1dd-b7286af370bf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:45.983268 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360916e-b132-4baa-b5ec-d2a27ab8da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.983901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360916e-b132-4baa-b5ec-d2a27ab8da08 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.984220 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360916e-b132-4baa-b5ec-d2a27ab8da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.984497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a360916e-b132-4baa-b5ec-d2a27ab8da08 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.985170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360916e-b132-4baa-b5ec-d2a27ab8da08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.987101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a360916e-b132-4baa-b5ec-d2a27ab8da08 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:45.989367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a54806-05e7-4110-b1dd-b7286af370bf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:45.994058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5779d0-5c26-4ace-898a-a14b0fa0884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:45.994785 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5779d0-5c26-4ace-898a-a14b0fa0884d admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:45.995073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5779d0-5c26-4ace-898a-a14b0fa0884d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:45.995454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5779d0-5c26-4ace-898a-a14b0fa0884d admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:45.996549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5779d0-5c26-4ace-898a-a14b0fa0884d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:45.999748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5779d0-5c26-4ace-898a-a14b0fa0884d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.010851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1315/2616] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:45 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:46.014596 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1302/2617] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:46.015402 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360916e-b132-4baa-b5ec-d2a27ab8da08 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.015544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5779d0-5c26-4ace-898a-a14b0fa0884d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.026964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5779d0-5c26-4ace-898a-a14b0fa0884d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.029845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a360916e-b132-4baa-b5ec-d2a27ab8da08 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.032165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc14398-e3e8-4b54-9002-4b5c1a12e70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.032850 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc14398-e3e8-4b54-9002-4b5c1a12e70c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.033137 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc14398-e3e8-4b54-9002-4b5c1a12e70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.033411 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc14398-e3e8-4b54-9002-4b5c1a12e70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.034108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc14398-e3e8-4b54-9002-4b5c1a12e70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.035216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b9373-3b9f-4083-83b5-083b88501af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.035676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc14398-e3e8-4b54-9002-4b5c1a12e70c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.035972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b9373-3b9f-4083-83b5-083b88501af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.036352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b9373-3b9f-4083-83b5-083b88501af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.036692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b9373-3b9f-4083-83b5-083b88501af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.037633 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b9373-3b9f-4083-83b5-083b88501af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.039636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b9373-3b9f-4083-83b5-083b88501af0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.047052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1303/2618] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:46.051375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc14398-e3e8-4b54-9002-4b5c1a12e70c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.052467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1316/2619] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:46.056252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b9373-3b9f-4083-83b5-083b88501af0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.066113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc14398-e3e8-4b54-9002-4b5c1a12e70c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.067920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b9373-3b9f-4083-83b5-083b88501af0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.071234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a71abe-fb0f-4ffa-896a-e68426adf25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.071703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a71abe-fb0f-4ffa-896a-e68426adf25a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.072041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a71abe-fb0f-4ffa-896a-e68426adf25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.072304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a71abe-fb0f-4ffa-896a-e68426adf25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.072983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a71abe-fb0f-4ffa-896a-e68426adf25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.074552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a71abe-fb0f-4ffa-896a-e68426adf25a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.078498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111eb11-b95e-4288-b996-87448f9f3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.078748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111eb11-b95e-4288-b996-87448f9f3727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.079202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111eb11-b95e-4288-b996-87448f9f3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.079709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111eb11-b95e-4288-b996-87448f9f3727 admin admin] PATH_INFO: `/v3/projects/33ab26f968db47a683b1e8e815427ce1/users/02ef57d67d424be7afec59590c6a5aac/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.085229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1304/2620] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:46.089691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a71abe-fb0f-4ffa-896a-e68426adf25a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.096906 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111eb11-b95e-4288-b996-87448f9f3727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ab26f968db47a683b1e8e815427ce1, user_id=02ef57d67d424be7afec59590c6a5aac, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.099108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a71abe-fb0f-4ffa-896a-e68426adf25a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.099510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111eb11-b95e-4288-b996-87448f9f3727 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.103719 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffb4ce7-9b23-45b2-b166-44b0161b90bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.104552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb4ce7-9b23-45b2-b166-44b0161b90bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.104938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb4ce7-9b23-45b2-b166-44b0161b90bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.105254 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffb4ce7-9b23-45b2-b166-44b0161b90bc admin admin] PATH_INFO: `/v3/projects/9a373d4a6e1d490aa9ea6d7c4ab86212/users/328a9c2136ea4fbbbfdf85a7e0977ae7/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.113869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1317/2621] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:46 2022] PUT /identity/v3/projects/33ab26f968db47a683b1e8e815427ce1/users/02ef57d67d424be7afec59590c6a5aac/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:46.124161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb4ce7-9b23-45b2-b166-44b0161b90bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a373d4a6e1d490aa9ea6d7c4ab86212, user_id=328a9c2136ea4fbbbfdf85a7e0977ae7, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.124449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf64b5-b54e-4597-9a34-506f7cf601da None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.124746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf64b5-b54e-4597-9a34-506f7cf601da None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.125069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf64b5-b54e-4597-9a34-506f7cf601da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.126817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffb4ce7-9b23-45b2-b166-44b0161b90bc admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.140435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1305/2622] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:46 2022] PUT /identity/v3/projects/9a373d4a6e1d490aa9ea6d7c4ab86212/users/328a9c2136ea4fbbbfdf85a7e0977ae7/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:46.157642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-0aaf64b5-b54e-4597-9a34-506f7cf601da None None] MFA Rules not processed for user `02ef57d67d424be7afec59590c6a5aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:46.159160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0aaf64b5-b54e-4597-9a34-506f7cf601da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:46.170407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:46.211434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2660f7-e47d-4904-8603-447ae12b3bbf None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.211815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2660f7-e47d-4904-8603-447ae12b3bbf None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.212194 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2660f7-e47d-4904-8603-447ae12b3bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.234135 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1318/2623] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:46.240947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6d2660f7-e47d-4904-8603-447ae12b3bbf None None] MFA Rules not processed for user `328a9c2136ea4fbbbfdf85a7e0977ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:46.242154 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6d2660f7-e47d-4904-8603-447ae12b3bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:46.244836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf64b5-b54e-4597-9a34-506f7cf601da None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.246166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0aaf64b5-b54e-4597-9a34-506f7cf601da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:46.306742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1306/2624] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:46.311264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2660f7-e47d-4904-8603-447ae12b3bbf None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.324757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf64b5-b54e-4597-9a34-506f7cf601da None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.330714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eadf0-f225-471b-88a9-7d73f6cfba18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.331344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eadf0-f225-471b-88a9-7d73f6cfba18 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.331634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eadf0-f225-471b-88a9-7d73f6cfba18 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.331908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eadf0-f225-471b-88a9-7d73f6cfba18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.340085 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eadf0-f225-471b-88a9-7d73f6cfba18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.342651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eadf0-f225-471b-88a9-7d73f6cfba18 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.352672 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1319/2625] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:50:46.371540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2660f7-e47d-4904-8603-447ae12b3bbf None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.378365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2ed3-eef4-4b61-b670-7ea46cd41488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.378737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2ed3-eef4-4b61-b670-7ea46cd41488 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.379101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2ed3-eef4-4b61-b670-7ea46cd41488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.379293 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf2ed3-eef4-4b61-b670-7ea46cd41488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.379959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf2ed3-eef4-4b61-b670-7ea46cd41488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.381869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf2ed3-eef4-4b61-b670-7ea46cd41488 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.416816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1307/2626] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:46 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:46.417881 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eadf0-f225-471b-88a9-7d73f6cfba18 service nova] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.428917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eadf0-f225-471b-88a9-7d73f6cfba18 service nova] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.492880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb90157-ada6-49ba-a69a-9ee6cea52a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.493729 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb90157-ada6-49ba-a69a-9ee6cea52a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.494147 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb90157-ada6-49ba-a69a-9ee6cea52a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.494460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb90157-ada6-49ba-a69a-9ee6cea52a5b admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.495163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb90157-ada6-49ba-a69a-9ee6cea52a5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.497182 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb90157-ada6-49ba-a69a-9ee6cea52a5b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.528501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1320/2627] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:46 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:46.530172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2ed3-eef4-4b61-b670-7ea46cd41488 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.541317 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf2ed3-eef4-4b61-b670-7ea46cd41488 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.546533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa8dd-ded9-468d-b636-a295b480cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.547141 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa8dd-ded9-468d-b636-a295b480cef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.547423 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa8dd-ded9-468d-b636-a295b480cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.547697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa8dd-ded9-468d-b636-a295b480cef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.548427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afa8dd-ded9-468d-b636-a295b480cef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.550012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19afa8dd-ded9-468d-b636-a295b480cef7 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.551579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:46.566595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1308/2628] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:46.568027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb90157-ada6-49ba-a69a-9ee6cea52a5b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.568569 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa8dd-ded9-468d-b636-a295b480cef7 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.578742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb90157-ada6-49ba-a69a-9ee6cea52a5b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.579893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa8dd-ded9-468d-b636-a295b480cef7 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.583731 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2c6f9-af97-43d3-87b1-bfe10e7e2e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.584492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2c6f9-af97-43d3-87b1-bfe10e7e2e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.584613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.584804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2c6f9-af97-43d3-87b1-bfe10e7e2e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.585045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2c6f9-af97-43d3-87b1-bfe10e7e2e81 admin admin] PATH_INFO: `/v3/projects/80fdd673b1714e67bc683919be56c910/users/6e89a32a6817490ebf4b98a8349889c4/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.585248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.585489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.585785 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] PATH_INFO: `/v3/users/02ef57d67d424be7afec59590c6a5aac` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.586927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ef57d67d424be7afec59590c6a5aac)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.589893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.600644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2c6f9-af97-43d3-87b1-bfe10e7e2e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fdd673b1714e67bc683919be56c910, user_id=6e89a32a6817490ebf4b98a8349889c4, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.603408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2c6f9-af97-43d3-87b1-bfe10e7e2e81 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.612525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:46.618371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1321/2629] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:46 2022] PUT /identity/v3/projects/80fdd673b1714e67bc683919be56c910/users/6e89a32a6817490ebf4b98a8349889c4/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:46.621941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2c6f9-af97-43d3-87b1-bfe10e7e2e81 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.639880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ef57d67d424be7afec59590c6a5aac'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:46.649797 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ef57d67d424be7afec59590c6a5aac'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:46.659053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ef57d67d424be7afec59590c6a5aac'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:46.659746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ef57d67d424be7afec59590c6a5aac'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:46.660415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-ca8e7f17-80d3-41e4-8b17-875869461c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ef57d67d424be7afec59590c6a5aac'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:46.678934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1309/2630] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:46 2022] DELETE /identity/v3/users/02ef57d67d424be7afec59590c6a5aac => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:46.683539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d05c5-759f-40b0-8720-463d9f53694b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.683844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d05c5-759f-40b0-8720-463d9f53694b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.684124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d05c5-759f-40b0-8720-463d9f53694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.692426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2c6f9-af97-43d3-87b1-bfe10e7e2e81 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.703479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-631d05c5-759f-40b0-8720-463d9f53694b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:46.704689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-631d05c5-759f-40b0-8720-463d9f53694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:46.748962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c98d0-25b8-4f02-92e0-a18bbac69a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.749577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c98d0-25b8-4f02-92e0-a18bbac69a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.749851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c98d0-25b8-4f02-92e0-a18bbac69a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.750126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c98d0-25b8-4f02-92e0-a18bbac69a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.750811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c98d0-25b8-4f02-92e0-a18bbac69a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.752469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c98d0-25b8-4f02-92e0-a18bbac69a3b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.761927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1322/2631] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:46.765414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1310/2632] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:46.766141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c98d0-25b8-4f02-92e0-a18bbac69a3b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.767774 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7b7c98d0-25b8-4f02-92e0-a18bbac69a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:46.773001 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d05c5-759f-40b0-8720-463d9f53694b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.774314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-631d05c5-759f-40b0-8720-463d9f53694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:46.780708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c98d0-25b8-4f02-92e0-a18bbac69a3b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.785283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1775ea-38d5-47e4-82b8-cc8bdf8b79ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.785966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1775ea-38d5-47e4-82b8-cc8bdf8b79ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.786243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1775ea-38d5-47e4-82b8-cc8bdf8b79ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.786505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1775ea-38d5-47e4-82b8-cc8bdf8b79ba admin admin] PATH_INFO: `/v3/projects/80fdd673b1714e67bc683919be56c910/users/6e89a32a6817490ebf4b98a8349889c4/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.788481 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1775ea-38d5-47e4-82b8-cc8bdf8b79ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=80fdd673b1714e67bc683919be56c910, user_id=6e89a32a6817490ebf4b98a8349889c4, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.791092 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1775ea-38d5-47e4-82b8-cc8bdf8b79ba admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.802072 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1323/2633] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:46 2022] PUT /identity/v3/projects/80fdd673b1714e67bc683919be56c910/users/6e89a32a6817490ebf4b98a8349889c4/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:46.813060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386367e5-2c52-4241-bb40-c0057cc3261f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.813341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386367e5-2c52-4241-bb40-c0057cc3261f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.814030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386367e5-2c52-4241-bb40-c0057cc3261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.839816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d05c5-759f-40b0-8720-463d9f53694b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.841617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-386367e5-2c52-4241-bb40-c0057cc3261f None None] MFA Rules not processed for user `6e89a32a6817490ebf4b98a8349889c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:46.842810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-386367e5-2c52-4241-bb40-c0057cc3261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:46.859273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:46.891703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62039e4-7645-49c9-8eed-cc8c0a37c45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.892346 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62039e4-7645-49c9-8eed-cc8c0a37c45b service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.892623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62039e4-7645-49c9-8eed-cc8c0a37c45b service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.892896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62039e4-7645-49c9-8eed-cc8c0a37c45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:46.915550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1324/2634] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:46.926902 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386367e5-2c52-4241-bb40-c0057cc3261f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:46.928406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-386367e5-2c52-4241-bb40-c0057cc3261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:46.947117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:46.955113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62039e4-7645-49c9-8eed-cc8c0a37c45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:46.956652 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62039e4-7645-49c9-8eed-cc8c0a37c45b service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:46.967016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1311/2635] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:50:46.988305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386367e5-2c52-4241-bb40-c0057cc3261f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:46.992516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2cc1-03df-4f1b-bed3-635cc87689f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:46.993197 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2cc1-03df-4f1b-bed3-635cc87689f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:46.993497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2cc1-03df-4f1b-bed3-635cc87689f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:46.993773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c2cc1-03df-4f1b-bed3-635cc87689f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.003313 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2cc1-03df-4f1b-bed3-635cc87689f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.004864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c2cc1-03df-4f1b-bed3-635cc87689f0 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.014487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1325/2636] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:50:47.093921 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62039e4-7645-49c9-8eed-cc8c0a37c45b service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.103272 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62039e4-7645-49c9-8eed-cc8c0a37c45b service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.107681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bbe12-165c-4b31-a67b-94919e50441a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.108563 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bbe12-165c-4b31-a67b-94919e50441a service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.108844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bbe12-165c-4b31-a67b-94919e50441a service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.109116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bbe12-165c-4b31-a67b-94919e50441a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.111025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-8a7bbe12-165c-4b31-a67b-94919e50441a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:47.174291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bbe12-165c-4b31-a67b-94919e50441a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.175707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bbe12-165c-4b31-a67b-94919e50441a service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.184773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1312/2637] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:47.253579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2cc1-03df-4f1b-bed3-635cc87689f0 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.255185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-328c2cc1-03df-4f1b-bed3-635cc87689f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:47.270795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c2cc1-03df-4f1b-bed3-635cc87689f0 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.282967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.283685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.284003 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.284353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] PATH_INFO: `/v3/projects/33ab26f968db47a683b1e8e815427ce1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.285646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ab26f968db47a683b1e8e815427ce1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.287811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.343151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ab26f968db47a683b1e8e815427ce1', 'request_id': 'req-e9d10000-d00e-4387-a278-19a1dd5124ab'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.349754 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ab26f968db47a683b1e8e815427ce1', 'request_id': 'req-e9d10000-d00e-4387-a278-19a1dd5124ab'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.357653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ab26f968db47a683b1e8e815427ce1', 'request_id': 'req-e9d10000-d00e-4387-a278-19a1dd5124ab'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.369395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] The token cache is being invalidate because project 33ab26f968db47a683b1e8e815427ce1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:47.369837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.370545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-e9d10000-d00e-4387-a278-19a1dd5124ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.372381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1326/2638] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:47 2022] DELETE /identity/v3/projects/33ab26f968db47a683b1e8e815427ce1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:47.377581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665b5b-4a92-431c-bb3f-1f0fb49f6029 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.377873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665b5b-4a92-431c-bb3f-1f0fb49f6029 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.378212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a665b5b-4a92-431c-bb3f-1f0fb49f6029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.399401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-7a665b5b-4a92-431c-bb3f-1f0fb49f6029 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:47.400625 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7a665b5b-4a92-431c-bb3f-1f0fb49f6029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:47.470268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1313/2639] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:47.479200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69597c4a-9d56-42c2-8f6b-46065306ac75 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.479938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69597c4a-9d56-42c2-8f6b-46065306ac75 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.479938 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69597c4a-9d56-42c2-8f6b-46065306ac75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.480287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a665b5b-4a92-431c-bb3f-1f0fb49f6029 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.481268 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7a665b5b-4a92-431c-bb3f-1f0fb49f6029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:47.493150 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a665b5b-4a92-431c-bb3f-1f0fb49f6029 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.498880 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.499534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.499810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.500077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] PATH_INFO: `/v3/users/328a9c2136ea4fbbbfdf85a7e0977ae7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.500504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-69597c4a-9d56-42c2-8f6b-46065306ac75 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:47.501285 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=328a9c2136ea4fbbbfdf85a7e0977ae7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.501693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-69597c4a-9d56-42c2-8f6b-46065306ac75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:47.503165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.508637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:47.509904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1327/2640] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:47.514674 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69597c4a-9d56-42c2-8f6b-46065306ac75 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.523946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69597c4a-9d56-42c2-8f6b-46065306ac75 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.528733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463ef14-885b-49f3-94e2-2c9b84eb5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.529449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463ef14-885b-49f3-94e2-2c9b84eb5f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.529786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463ef14-885b-49f3-94e2-2c9b84eb5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.530162 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463ef14-885b-49f3-94e2-2c9b84eb5f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.530905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463ef14-885b-49f3-94e2-2c9b84eb5f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:50:47.531273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463ef14-885b-49f3-94e2-2c9b84eb5f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.533012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b463ef14-885b-49f3-94e2-2c9b84eb5f41 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.545476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1328/2641] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:50:47.549461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463ef14-885b-49f3-94e2-2c9b84eb5f41 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.554564 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328a9c2136ea4fbbbfdf85a7e0977ae7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.558967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463ef14-885b-49f3-94e2-2c9b84eb5f41 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.562825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328a9c2136ea4fbbbfdf85a7e0977ae7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.564433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1b898-eb5a-4e31-a8ff-4e2b8a72bb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.565055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1b898-eb5a-4e31-a8ff-4e2b8a72bb55 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.565339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1b898-eb5a-4e31-a8ff-4e2b8a72bb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.565613 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1b898-eb5a-4e31-a8ff-4e2b8a72bb55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.566267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1b898-eb5a-4e31-a8ff-4e2b8a72bb55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.568511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1b898-eb5a-4e31-a8ff-4e2b8a72bb55 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.570638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328a9c2136ea4fbbbfdf85a7e0977ae7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.571322 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328a9c2136ea4fbbbfdf85a7e0977ae7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.572042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-be1e2310-ac1f-4b7c-bb43-b69d2f090afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328a9c2136ea4fbbbfdf85a7e0977ae7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:47.591931 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1314/2642] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:47 2022] DELETE /identity/v3/users/328a9c2136ea4fbbbfdf85a7e0977ae7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:47.595963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c21da-36e1-4de2-95aa-cabfa00ff3f6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.596277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c21da-36e1-4de2-95aa-cabfa00ff3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.596657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c21da-36e1-4de2-95aa-cabfa00ff3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.600625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1329/2643] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:47 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:47.601511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1b898-eb5a-4e31-a8ff-4e2b8a72bb55 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.603032 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-dda1b898-eb5a-4e31-a8ff-4e2b8a72bb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:47.615783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-193c21da-36e1-4de2-95aa-cabfa00ff3f6 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:47.617026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-193c21da-36e1-4de2-95aa-cabfa00ff3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:47.666421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1b898-eb5a-4e31-a8ff-4e2b8a72bb55 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.671498 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c272f8-7313-448b-a249-173a4c90f52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.672115 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c272f8-7313-448b-a249-173a4c90f52c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.672494 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c272f8-7313-448b-a249-173a4c90f52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.672769 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c272f8-7313-448b-a249-173a4c90f52c admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.673440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c272f8-7313-448b-a249-173a4c90f52c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.675349 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c272f8-7313-448b-a249-173a4c90f52c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.678250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1315/2644] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:47.683296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:47.690250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c21da-36e1-4de2-95aa-cabfa00ff3f6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.691937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-193c21da-36e1-4de2-95aa-cabfa00ff3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:47.699608 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1330/2645] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:47 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:47.703644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c272f8-7313-448b-a249-173a4c90f52c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.713226 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c272f8-7313-448b-a249-173a4c90f52c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.717930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ae7b-9f97-448a-89f3-a255c5bce35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.718638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ae7b-9f97-448a-89f3-a255c5bce35f admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.718923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ae7b-9f97-448a-89f3-a255c5bce35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.719195 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da3ae7b-9f97-448a-89f3-a255c5bce35f admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.719910 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3ae7b-9f97-448a-89f3-a255c5bce35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.721561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da3ae7b-9f97-448a-89f3-a255c5bce35f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.731479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1331/2646] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:47.735952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ae7b-9f97-448a-89f3-a255c5bce35f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.746055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da3ae7b-9f97-448a-89f3-a255c5bce35f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.749566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c21da-36e1-4de2-95aa-cabfa00ff3f6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.751373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a23c-d52e-463c-991a-ede07e247155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.751962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a23c-d52e-463c-991a-ede07e247155 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.752290 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a23c-d52e-463c-991a-ede07e247155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.752567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7a23c-d52e-463c-991a-ede07e247155 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.753244 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7a23c-d52e-463c-991a-ede07e247155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.753351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87abcc-54ca-4185-add2-b3dd52247cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.753847 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87abcc-54ca-4185-add2-b3dd52247cec service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.754129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87abcc-54ca-4185-add2-b3dd52247cec service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.754397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87abcc-54ca-4185-add2-b3dd52247cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.755153 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7a23c-d52e-463c-991a-ede07e247155 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.763362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87abcc-54ca-4185-add2-b3dd52247cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.764802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87abcc-54ca-4185-add2-b3dd52247cec service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.766168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1332/2647] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:47.770438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a23c-d52e-463c-991a-ede07e247155 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:47.777339 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1316/2648] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:47.780327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7a23c-d52e-463c-991a-ede07e247155 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:47.784915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe150-7f66-4548-9c80-06dce6211309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:47.785575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe150-7f66-4548-9c80-06dce6211309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.785856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe150-7f66-4548-9c80-06dce6211309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.786151 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489fe150-7f66-4548-9c80-06dce6211309 admin admin] PATH_INFO: `/v3/projects/24dc7bf0805a453ea068618c4ebbe991/users/120f4760b72a40418b6d634ca566eadf/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.804393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe150-7f66-4548-9c80-06dce6211309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24dc7bf0805a453ea068618c4ebbe991, user_id=120f4760b72a40418b6d634ca566eadf, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:47.807091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489fe150-7f66-4548-9c80-06dce6211309 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:47.820926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1333/2649] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:47 2022] PUT /identity/v3/projects/24dc7bf0805a453ea068618c4ebbe991/users/120f4760b72a40418b6d634ca566eadf/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:47.832300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7486d-8efb-4fb8-841c-cee21b65da82 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:47.832741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7486d-8efb-4fb8-841c-cee21b65da82 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:47.833082 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7486d-8efb-4fb8-841c-cee21b65da82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:47.866225 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-62c7486d-8efb-4fb8-841c-cee21b65da82 None None] MFA Rules not processed for user `120f4760b72a40418b6d634ca566eadf`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:47.867520 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-62c7486d-8efb-4fb8-841c-cee21b65da82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:47.885989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:47.938389 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1317/2650] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:47.942765 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe150-7f66-4548-9c80-06dce6211309 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.007497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489fe150-7f66-4548-9c80-06dce6211309 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.012398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdf961-0f46-4a70-859f-12322af744d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.012907 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf961-0f46-4a70-859f-12322af744d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.013734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf961-0f46-4a70-859f-12322af744d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.014013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbdf961-0f46-4a70-859f-12322af744d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.014681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdf961-0f46-4a70-859f-12322af744d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.016621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbdf961-0f46-4a70-859f-12322af744d6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.044589 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1334/2651] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:47 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:48.048470 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7486d-8efb-4fb8-841c-cee21b65da82 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.059485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7486d-8efb-4fb8-841c-cee21b65da82 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.072569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdf961-0f46-4a70-859f-12322af744d6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.074802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-dbbdf961-0f46-4a70-859f-12322af744d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:48.137106 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab38e7a-c583-4616-b09a-389a270ddc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.137737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab38e7a-c583-4616-b09a-389a270ddc1d admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.138022 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab38e7a-c583-4616-b09a-389a270ddc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.138859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab38e7a-c583-4616-b09a-389a270ddc1d admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.139592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab38e7a-c583-4616-b09a-389a270ddc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.141622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab38e7a-c583-4616-b09a-389a270ddc1d admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.148444 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbdf961-0f46-4a70-859f-12322af744d6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.153305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.153985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.154265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.154557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] PATH_INFO: `/v3/projects/9a373d4a6e1d490aa9ea6d7c4ab86212` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.156006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a373d4a6e1d490aa9ea6d7c4ab86212)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.158019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.167551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1318/2652] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:48 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:48.171273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab38e7a-c583-4616-b09a-389a270ddc1d admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.182369 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab38e7a-c583-4616-b09a-389a270ddc1d admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.189932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e60d-7986-4f3a-a0b1-4c0d8bd444f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.190575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e60d-7986-4f3a-a0b1-4c0d8bd444f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.190839 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e60d-7986-4f3a-a0b1-4c0d8bd444f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.191207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e60d-7986-4f3a-a0b1-4c0d8bd444f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.191944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e60d-7986-4f3a-a0b1-4c0d8bd444f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.193559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e60d-7986-4f3a-a0b1-4c0d8bd444f0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.198767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:INSERT=5,keystone:SELECT=93,keystone:DELETE=2 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:48.205537 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1319/2653] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:48.209785 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e60d-7986-4f3a-a0b1-4c0d8bd444f0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.214854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a373d4a6e1d490aa9ea6d7c4ab86212', 'request_id': 'req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.219523 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e60d-7986-4f3a-a0b1-4c0d8bd444f0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.221203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a373d4a6e1d490aa9ea6d7c4ab86212', 'request_id': 'req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.229625 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a373d4a6e1d490aa9ea6d7c4ab86212', 'request_id': 'req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.240581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] The token cache is being invalidate because project 9a373d4a6e1d490aa9ea6d7c4ab86212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:48.240870 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.241518 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.243148 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1335/2654] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:48 2022] DELETE /identity/v3/projects/9a373d4a6e1d490aa9ea6d7c4ab86212 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:48.247408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.250260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:48.282951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b428c-9a73-4e87-a2b7-5d1cffe03ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.283624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b428c-9a73-4e87-a2b7-5d1cffe03ba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.283901 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b428c-9a73-4e87-a2b7-5d1cffe03ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.284213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b428c-9a73-4e87-a2b7-5d1cffe03ba5 admin admin] PATH_INFO: `/v3/projects/c506d3e2e486476d881177f6b3c740b5/users/a7c165efea474f60ad5185112a8c0081/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.298663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b428c-9a73-4e87-a2b7-5d1cffe03ba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c506d3e2e486476d881177f6b3c740b5, user_id=a7c165efea474f60ad5185112a8c0081, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.301321 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b428c-9a73-4e87-a2b7-5d1cffe03ba5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.314963 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1320/2655] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:48 2022] PUT /identity/v3/projects/c506d3e2e486476d881177f6b3c740b5/users/a7c165efea474f60ad5185112a8c0081/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:48.318870 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b428c-9a73-4e87-a2b7-5d1cffe03ba5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.320562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b57b428c-9a73-4e87-a2b7-5d1cffe03ba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:48.321094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a2f1-82f4-42f4-af1c-6a46c79b174b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.343384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:48.380036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.380859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.381261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.381664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] PATH_INFO: `/v3/users/6e89a32a6817490ebf4b98a8349889c4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.382966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e89a32a6817490ebf4b98a8349889c4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.385082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.388203 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b428c-9a73-4e87-a2b7-5d1cffe03ba5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.395665 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4fa46-4d54-475a-ae11-ebc48bdfd7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.397008 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4fa46-4d54-475a-ae11-ebc48bdfd7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.397288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4fa46-4d54-475a-ae11-ebc48bdfd7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.397561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f4fa46-4d54-475a-ae11-ebc48bdfd7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.398286 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4fa46-4d54-475a-ae11-ebc48bdfd7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.400557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f4fa46-4d54-475a-ae11-ebc48bdfd7f6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.413028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1321/2656] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:48.417273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4fa46-4d54-475a-ae11-ebc48bdfd7f6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.427245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f4fa46-4d54-475a-ae11-ebc48bdfd7f6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.431851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb59ba-7565-4557-a634-b3924bf33032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.432535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb59ba-7565-4557-a634-b3924bf33032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.432813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb59ba-7565-4557-a634-b3924bf33032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.433087 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb59ba-7565-4557-a634-b3924bf33032 admin admin] PATH_INFO: `/v3/projects/c506d3e2e486476d881177f6b3c740b5/users/a7c165efea474f60ad5185112a8c0081/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.434337 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e89a32a6817490ebf4b98a8349889c4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.435507 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb59ba-7565-4557-a634-b3924bf33032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c506d3e2e486476d881177f6b3c740b5, user_id=a7c165efea474f60ad5185112a8c0081, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.438128 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb59ba-7565-4557-a634-b3924bf33032 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.447103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e89a32a6817490ebf4b98a8349889c4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.448218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1322/2657] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:48 2022] PUT /identity/v3/projects/c506d3e2e486476d881177f6b3c740b5/users/a7c165efea474f60ad5185112a8c0081/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:48.449451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:48.458707 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e89a32a6817490ebf4b98a8349889c4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.459196 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ddb44-8c72-43c5-9f75-cfef1108f2a8 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.459488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ddb44-8c72-43c5-9f75-cfef1108f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.459775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ddb44-8c72-43c5-9f75-cfef1108f2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.459892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e89a32a6817490ebf4b98a8349889c4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.460742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e89a32a6817490ebf4b98a8349889c4'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.474967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1336/2658] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:48 2022] DELETE /identity/v3/users/6e89a32a6817490ebf4b98a8349889c4 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:48.494296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-202ddb44-8c72-43c5-9f75-cfef1108f2a8 None None] MFA Rules not processed for user `a7c165efea474f60ad5185112a8c0081`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:48.495713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-202ddb44-8c72-43c5-9f75-cfef1108f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:48.571626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1323/2659] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:48.586387 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.587956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:48.670497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b1966-d63e-4076-a42f-38c18524f20d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.674516 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86202d5-a776-4415-9c79-16b951580b23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.675141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86202d5-a776-4415-9c79-16b951580b23 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.675421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86202d5-a776-4415-9c79-16b951580b23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.675701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86202d5-a776-4415-9c79-16b951580b23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.686171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86202d5-a776-4415-9c79-16b951580b23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.687682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86202d5-a776-4415-9c79-16b951580b23 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.697860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1337/2660] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:50:48.761201 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ddb44-8c72-43c5-9f75-cfef1108f2a8 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.762878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-202ddb44-8c72-43c5-9f75-cfef1108f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:48.785202 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86202d5-a776-4415-9c79-16b951580b23 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:48.796877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86202d5-a776-4415-9c79-16b951580b23 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.801570 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.802200 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.808045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.808045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.808045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:48.841085 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ddb44-8c72-43c5-9f75-cfef1108f2a8 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:48.846633 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:48.847383 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:48.847726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:48.848454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] PATH_INFO: `/v3/projects/80fdd673b1714e67bc683919be56c910` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:48.849805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80fdd673b1714e67bc683919be56c910)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.855943 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.876358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:48.877813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:48.887081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1338/2661] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:50:48.891581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:48.906878 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80fdd673b1714e67bc683919be56c910', 'request_id': 'req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.913534 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80fdd673b1714e67bc683919be56c910', 'request_id': 'req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.920944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80fdd673b1714e67bc683919be56c910', 'request_id': 'req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.932773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] The token cache is being invalidate because project 80fdd673b1714e67bc683919be56c910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:48.933148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.933849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-98bd33b1-1d0c-47b2-a557-7eb9fa5b8314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:48.935805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1324/2662] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:48 2022] DELETE /identity/v3/projects/80fdd673b1714e67bc683919be56c910 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:51.622446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:51.624433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:51.637478 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5af8a0-1fb2-4449-b620-694151baed2f service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:51.693718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:51.694354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:51.694640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:51.694914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] PATH_INFO: `/v3/users/120f4760b72a40418b6d634ca566eadf` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:51.696081 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] RBAC: Authorizing `identity:delete_user(user_id=120f4760b72a40418b6d634ca566eadf)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:51.698020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:51.725245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:51.745185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120f4760b72a40418b6d634ca566eadf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:51.756980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120f4760b72a40418b6d634ca566eadf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:51.764588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120f4760b72a40418b6d634ca566eadf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:51.765249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120f4760b72a40418b6d634ca566eadf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:51.765854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120f4760b72a40418b6d634ca566eadf'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:51.778445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1339/2663] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:51 2022] DELETE /identity/v3/users/120f4760b72a40418b6d634ca566eadf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:51.783602 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822b866-79d4-44e3-a5b9-581eda4d2ae5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:51.784113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822b866-79d4-44e3-a5b9-581eda4d2ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:51.784113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822b866-79d4-44e3-a5b9-581eda4d2ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:51.803868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-9822b866-79d4-44e3-a5b9-581eda4d2ae5 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:51.805119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9822b866-79d4-44e3-a5b9-581eda4d2ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:51.876686 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1325/2664] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:51.886469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:51.887901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:51.944819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43310e9e-9d15-45b7-bf7d-f016328e36da admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:51.948403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e24187-e395-4167-9a7f-541168714c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:51.949014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e24187-e395-4167-9a7f-541168714c2d service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:51.949295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e24187-e395-4167-9a7f-541168714c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:51.949567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e24187-e395-4167-9a7f-541168714c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:51.959019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e24187-e395-4167-9a7f-541168714c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:51.960489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e24187-e395-4167-9a7f-541168714c2d service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:51.969778 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1340/2665] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:52.244993 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822b866-79d4-44e3-a5b9-581eda4d2ae5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:52.246656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9822b866-79d4-44e3-a5b9-581eda4d2ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:52.258908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9822b866-79d4-44e3-a5b9-581eda4d2ae5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:52.263686 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:52.264362 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:52.264641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:52.264907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] PATH_INFO: `/v3/projects/24dc7bf0805a453ea068618c4ebbe991` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:52.266053 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24dc7bf0805a453ea068618c4ebbe991)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:52.268536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:52.316347 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24dc7bf0805a453ea068618c4ebbe991', 'request_id': 'req-617eee10-2c78-4917-8ba2-29bcc3856b65'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.323393 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24dc7bf0805a453ea068618c4ebbe991', 'request_id': 'req-617eee10-2c78-4917-8ba2-29bcc3856b65'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.329618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24dc7bf0805a453ea068618c4ebbe991', 'request_id': 'req-617eee10-2c78-4917-8ba2-29bcc3856b65'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.340010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] The token cache is being invalidate because project 24dc7bf0805a453ea068618c4ebbe991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:52.340319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.340946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.342471 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1326/2666] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:52 2022] DELETE /identity/v3/projects/24dc7bf0805a453ea068618c4ebbe991 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:52.346488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e24187-e395-4167-9a7f-541168714c2d service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:52.355926 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e24187-e395-4167-9a7f-541168714c2d service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:52.414782 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:52.415431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:52.415712 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:52.415988 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] PATH_INFO: `/v3/users/a7c165efea474f60ad5185112a8c0081` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:52.417186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c165efea474f60ad5185112a8c0081)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:52.419112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:52.464403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c165efea474f60ad5185112a8c0081'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.466263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:52.478449 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c165efea474f60ad5185112a8c0081'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.485798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c165efea474f60ad5185112a8c0081'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.486587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c165efea474f60ad5185112a8c0081'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.487407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-5ec29074-9559-4f04-aaaf-40b7cef3d9ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c165efea474f60ad5185112a8c0081'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.500813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1341/2667] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:52 2022] DELETE /identity/v3/users/a7c165efea474f60ad5185112a8c0081 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:52.814171 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:52.815695 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:52.829690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eee10-2c78-4917-8ba2-29bcc3856b65 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:52.870734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:52.888601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:52.889243 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:52.889524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:52.889798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] PATH_INFO: `/v3/projects/c506d3e2e486476d881177f6b3c740b5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:52.890964 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c506d3e2e486476d881177f6b3c740b5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:52.892909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:52.938439 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c506d3e2e486476d881177f6b3c740b5', 'request_id': 'req-10abec19-330b-47a7-befc-e9db617b86c1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.944775 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c506d3e2e486476d881177f6b3c740b5', 'request_id': 'req-10abec19-330b-47a7-befc-e9db617b86c1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.951455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c506d3e2e486476d881177f6b3c740b5', 'request_id': 'req-10abec19-330b-47a7-befc-e9db617b86c1'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.961457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] The token cache is being invalidate because project c506d3e2e486476d881177f6b3c740b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:52.961741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.962355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-10abec19-330b-47a7-befc-e9db617b86c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:52.963842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1327/2668] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:52 2022] DELETE /identity/v3/projects/c506d3e2e486476d881177f6b3c740b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:52.970502 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc51df-baa5-4c96-8007-61d95ae89c33 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:52.971014 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc51df-baa5-4c96-8007-61d95ae89c33 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:52.971114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc51df-baa5-4c96-8007-61d95ae89c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:52.990396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4adc51df-baa5-4c96-8007-61d95ae89c33 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:52.991597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4adc51df-baa5-4c96-8007-61d95ae89c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:53.049934 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1342/2669] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:53.059024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a63f-16f1-43e0-841d-4a537a692c80 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.059309 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a63f-16f1-43e0-841d-4a537a692c80 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.059589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7a63f-16f1-43e0-841d-4a537a692c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.079038 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-5fb7a63f-16f1-43e0-841d-4a537a692c80 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:53.080250 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-5fb7a63f-16f1-43e0-841d-4a537a692c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:53.088356 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1328/2670] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:50:53.093080 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc51df-baa5-4c96-8007-61d95ae89c33 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:53.102622 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc51df-baa5-4c96-8007-61d95ae89c33 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:53.107257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf88a6a-080b-4d3c-8dc5-c5b4753ecab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:53.107872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf88a6a-080b-4d3c-8dc5-c5b4753ecab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.108174 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf88a6a-080b-4d3c-8dc5-c5b4753ecab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.108453 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf88a6a-080b-4d3c-8dc5-c5b4753ecab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.109149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf88a6a-080b-4d3c-8dc5-c5b4753ecab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:50:53.109458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf88a6a-080b-4d3c-8dc5-c5b4753ecab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:53.111057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf88a6a-080b-4d3c-8dc5-c5b4753ecab2 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:53.122569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1343/2671] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:50:53.126699 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7a63f-16f1-43e0-841d-4a537a692c80 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:53.135734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7a63f-16f1-43e0-841d-4a537a692c80 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:53.140900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801dbb2-05f1-4399-9033-88f2238a8741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:53.141497 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801dbb2-05f1-4399-9033-88f2238a8741 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.141779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801dbb2-05f1-4399-9033-88f2238a8741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.142050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801dbb2-05f1-4399-9033-88f2238a8741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.142718 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801dbb2-05f1-4399-9033-88f2238a8741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:53.144663 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801dbb2-05f1-4399-9033-88f2238a8741 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:53.171910 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1329/2672] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:53 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:53.175915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf88a6a-080b-4d3c-8dc5-c5b4753ecab2 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:53.185698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf88a6a-080b-4d3c-8dc5-c5b4753ecab2 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:53.241856 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbc4e5-4a11-4060-93bf-82c1c0ed7531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:53.242475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbc4e5-4a11-4060-93bf-82c1c0ed7531 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.242757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbc4e5-4a11-4060-93bf-82c1c0ed7531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.243031 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbc4e5-4a11-4060-93bf-82c1c0ed7531 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.243694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbc4e5-4a11-4060-93bf-82c1c0ed7531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:53.245647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccbc4e5-4a11-4060-93bf-82c1c0ed7531 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:53.266643 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1344/2673] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:53 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:53.271009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801dbb2-05f1-4399-9033-88f2238a8741 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:53.282169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801dbb2-05f1-4399-9033-88f2238a8741 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:53.286768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62679e-1380-4038-9c71-a6d3c4b88fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:53.287370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62679e-1380-4038-9c71-a6d3c4b88fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.287653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62679e-1380-4038-9c71-a6d3c4b88fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.287928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62679e-1380-4038-9c71-a6d3c4b88fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.288656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62679e-1380-4038-9c71-a6d3c4b88fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:53.290236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62679e-1380-4038-9c71-a6d3c4b88fb3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:53.299965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1330/2674] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:53.303863 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbc4e5-4a11-4060-93bf-82c1c0ed7531 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:53.313603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbc4e5-4a11-4060-93bf-82c1c0ed7531 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:53.318155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975147-8ce8-4b2a-a58c-bbe5c565b223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:53.318753 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975147-8ce8-4b2a-a58c-bbe5c565b223 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.319033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975147-8ce8-4b2a-a58c-bbe5c565b223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.319305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975147-8ce8-4b2a-a58c-bbe5c565b223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.319991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d975147-8ce8-4b2a-a58c-bbe5c565b223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:53.321603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d975147-8ce8-4b2a-a58c-bbe5c565b223 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:53.331684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1345/2675] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:53.335577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62679e-1380-4038-9c71-a6d3c4b88fb3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:53.346121 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62679e-1380-4038-9c71-a6d3c4b88fb3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:53.350733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675aed-7051-422e-bbce-7138e55b7cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:53.351385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675aed-7051-422e-bbce-7138e55b7cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.351667 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675aed-7051-422e-bbce-7138e55b7cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.351951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b675aed-7051-422e-bbce-7138e55b7cbe admin admin] PATH_INFO: `/v3/projects/0fdcf332717d43d8be62c90b027193b4/users/a608592ddf684d4fb386a90bf6b8b471/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.366953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b675aed-7051-422e-bbce-7138e55b7cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fdcf332717d43d8be62c90b027193b4, user_id=a608592ddf684d4fb386a90bf6b8b471, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:53.369676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b675aed-7051-422e-bbce-7138e55b7cbe admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:53.382841 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1331/2676] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:53 2022] PUT /identity/v3/projects/0fdcf332717d43d8be62c90b027193b4/users/a608592ddf684d4fb386a90bf6b8b471/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:53.393930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5170c-4e71-406f-96c9-82107cfaaa35 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.394221 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5170c-4e71-406f-96c9-82107cfaaa35 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.394505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5170c-4e71-406f-96c9-82107cfaaa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.545248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-eae5170c-4e71-406f-96c9-82107cfaaa35 None None] MFA Rules not processed for user `a608592ddf684d4fb386a90bf6b8b471`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:53.546462 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-eae5170c-4e71-406f-96c9-82107cfaaa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:53.565808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:53.609996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1346/2677] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:53.621054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675aed-7051-422e-bbce-7138e55b7cbe admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:53.623208 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3b675aed-7051-422e-bbce-7138e55b7cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:53.680547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b675aed-7051-422e-bbce-7138e55b7cbe admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:53.683986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb99e9-7bfe-4eaa-9094-57e78a7af0a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:53.684624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb99e9-7bfe-4eaa-9094-57e78a7af0a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.685418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb99e9-7bfe-4eaa-9094-57e78a7af0a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.685696 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb99e9-7bfe-4eaa-9094-57e78a7af0a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.693749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb99e9-7bfe-4eaa-9094-57e78a7af0a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:53.695148 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb99e9-7bfe-4eaa-9094-57e78a7af0a2 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:53.704369 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1332/2678] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:53.723036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5170c-4e71-406f-96c9-82107cfaaa35 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:53.782678 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5170c-4e71-406f-96c9-82107cfaaa35 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:53.787673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:53.787859 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.788127 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.788430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] PATH_INFO: `/v3/users/a608592ddf684d4fb386a90bf6b8b471` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.789598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a608592ddf684d4fb386a90bf6b8b471)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:53.791506 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:53.843697 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a608592ddf684d4fb386a90bf6b8b471'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:53.855619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a608592ddf684d4fb386a90bf6b8b471'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:53.862844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a608592ddf684d4fb386a90bf6b8b471'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:53.864044 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a608592ddf684d4fb386a90bf6b8b471'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:53.864237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a608592ddf684d4fb386a90bf6b8b471'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:53.877747 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1347/2679] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:53 2022] DELETE /identity/v3/users/a608592ddf684d4fb386a90bf6b8b471 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:53.882388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4ca58-38ad-4e3a-9adf-e1d74ab89ee0 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:53.882838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4ca58-38ad-4e3a-9adf-e1d74ab89ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:53.882934 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a4ca58-38ad-4e3a-9adf-e1d74ab89ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:53.902532 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-99a4ca58-38ad-4e3a-9adf-e1d74ab89ee0 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:53.903728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-99a4ca58-38ad-4e3a-9adf-e1d74ab89ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:53.908633 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:53.961789 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1333/2680] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:53.971486 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:53.972925 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:54.017549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:54.029783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b8fb7-0590-4284-a78c-5bd64d7b04b8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:54.033370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8ac0e-8b32-4a86-832c-2d73484727bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:54.033975 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ac0e-8b32-4a86-832c-2d73484727bc service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.034254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ac0e-8b32-4a86-832c-2d73484727bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.034526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ac0e-8b32-4a86-832c-2d73484727bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.043310 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8ac0e-8b32-4a86-832c-2d73484727bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:54.045271 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af8ac0e-8b32-4a86-832c-2d73484727bc service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:54.054860 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1348/2681] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:54.211074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4ca58-38ad-4e3a-9adf-e1d74ab89ee0 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:54.212567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-99a4ca58-38ad-4e3a-9adf-e1d74ab89ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:54.269017 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a4ca58-38ad-4e3a-9adf-e1d74ab89ee0 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:54.272816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243bfd8-61b0-4c4b-8c1c-673e61f15a31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:54.273433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243bfd8-61b0-4c4b-8c1c-673e61f15a31 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.273711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243bfd8-61b0-4c4b-8c1c-673e61f15a31 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.273983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243bfd8-61b0-4c4b-8c1c-673e61f15a31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.275794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-1243bfd8-61b0-4c4b-8c1c-673e61f15a31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:54.321713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8ac0e-8b32-4a86-832c-2d73484727bc service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:54.323233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9af8ac0e-8b32-4a86-832c-2d73484727bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:54.340344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8ac0e-8b32-4a86-832c-2d73484727bc service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:54.348762 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:54.349897 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.350155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.350428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] PATH_INFO: `/v3/projects/0fdcf332717d43d8be62c90b027193b4` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.352018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fdcf332717d43d8be62c90b027193b4)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:54.353970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:54.366511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243bfd8-61b0-4c4b-8c1c-673e61f15a31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:54.368025 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243bfd8-61b0-4c4b-8c1c-673e61f15a31 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:54.388241 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1334/2682] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:54.404617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fdcf332717d43d8be62c90b027193b4', 'request_id': 'req-6df0132a-5e72-4f42-a07f-d1ca0d79f003'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:54.411114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fdcf332717d43d8be62c90b027193b4', 'request_id': 'req-6df0132a-5e72-4f42-a07f-d1ca0d79f003'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:54.420599 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fdcf332717d43d8be62c90b027193b4', 'request_id': 'req-6df0132a-5e72-4f42-a07f-d1ca0d79f003'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:54.431771 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] The token cache is being invalidate because project 0fdcf332717d43d8be62c90b027193b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:54.432065 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:54.432726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6df0132a-5e72-4f42-a07f-d1ca0d79f003 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:54.434218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1349/2683] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:54 2022] DELETE /identity/v3/projects/0fdcf332717d43d8be62c90b027193b4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:54.439016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1ffcd-df9d-456e-ba5f-20d2726cf0fc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.439300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1ffcd-df9d-456e-ba5f-20d2726cf0fc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.439577 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1ffcd-df9d-456e-ba5f-20d2726cf0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.461052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-a9f1ffcd-df9d-456e-ba5f-20d2726cf0fc None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:54.462375 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-a9f1ffcd-df9d-456e-ba5f-20d2726cf0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:54.496058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:54.524051 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1335/2684] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:54.532401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb89eae-39db-41bb-a434-edd38a9bdaeb None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.532685 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb89eae-39db-41bb-a434-edd38a9bdaeb None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.532957 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb89eae-39db-41bb-a434-edd38a9bdaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.555419 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-bbb89eae-39db-41bb-a434-edd38a9bdaeb None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:54.556756 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bbb89eae-39db-41bb-a434-edd38a9bdaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:54.565019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1350/2685] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:54.569328 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1ffcd-df9d-456e-ba5f-20d2726cf0fc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:54.579642 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1ffcd-df9d-456e-ba5f-20d2726cf0fc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:54.584445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2052f3-0763-4de2-96f5-a0638f9f6c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:54.585055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2052f3-0763-4de2-96f5-a0638f9f6c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.585334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2052f3-0763-4de2-96f5-a0638f9f6c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.585605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2052f3-0763-4de2-96f5-a0638f9f6c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.586300 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2052f3-0763-4de2-96f5-a0638f9f6c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:50:54.586606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2052f3-0763-4de2-96f5-a0638f9f6c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:54.588202 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2052f3-0763-4de2-96f5-a0638f9f6c40 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:54.600979 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1336/2686] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:50:54.605491 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb89eae-39db-41bb-a434-edd38a9bdaeb None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:54.614661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb89eae-39db-41bb-a434-edd38a9bdaeb None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:54.621158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd246f-546b-40bf-a9ca-445d0c6c1c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:54.622199 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd246f-546b-40bf-a9ca-445d0c6c1c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.622647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd246f-546b-40bf-a9ca-445d0c6c1c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.623090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd246f-546b-40bf-a9ca-445d0c6c1c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.623923 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd246f-546b-40bf-a9ca-445d0c6c1c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:54.625849 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd246f-546b-40bf-a9ca-445d0c6c1c67 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:54.655702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1351/2687] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:54 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:54.661176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2052f3-0763-4de2-96f5-a0638f9f6c40 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:54.673418 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2052f3-0763-4de2-96f5-a0638f9f6c40 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:54.735962 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a9fd4-8a40-42ad-bbf0-95f309a304bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:54.736660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a9fd4-8a40-42ad-bbf0-95f309a304bf admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.736946 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a9fd4-8a40-42ad-bbf0-95f309a304bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.737225 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a9fd4-8a40-42ad-bbf0-95f309a304bf admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.737893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a9fd4-8a40-42ad-bbf0-95f309a304bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:54.739834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a9fd4-8a40-42ad-bbf0-95f309a304bf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:54.761814 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1337/2688] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:54 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:54.766438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd246f-546b-40bf-a9ca-445d0c6c1c67 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:54.777090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd246f-546b-40bf-a9ca-445d0c6c1c67 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:54.782454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a72fd-3eee-4729-8459-3f7d5b5c29b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:54.783071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a72fd-3eee-4729-8459-3f7d5b5c29b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.783354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a72fd-3eee-4729-8459-3f7d5b5c29b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.783628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a72fd-3eee-4729-8459-3f7d5b5c29b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.784359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a72fd-3eee-4729-8459-3f7d5b5c29b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:54.785949 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a72fd-3eee-4729-8459-3f7d5b5c29b8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:54.799222 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1352/2689] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:54.800525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a9fd4-8a40-42ad-bbf0-95f309a304bf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:54.811153 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a9fd4-8a40-42ad-bbf0-95f309a304bf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:54.815861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb486832-ca5e-40d8-b532-01797932485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:54.816508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb486832-ca5e-40d8-b532-01797932485b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.816817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb486832-ca5e-40d8-b532-01797932485b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.817093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb486832-ca5e-40d8-b532-01797932485b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.817864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb486832-ca5e-40d8-b532-01797932485b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:54.819491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb486832-ca5e-40d8-b532-01797932485b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:54.830853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1338/2690] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:54.835038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a72fd-3eee-4729-8459-3f7d5b5c29b8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:54.845710 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a72fd-3eee-4729-8459-3f7d5b5c29b8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:54.850291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910803d-f721-4469-9ccc-3bf0794ae4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:54.850947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910803d-f721-4469-9ccc-3bf0794ae4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.851224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910803d-f721-4469-9ccc-3bf0794ae4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.851493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0910803d-f721-4469-9ccc-3bf0794ae4d6 admin admin] PATH_INFO: `/v3/projects/f4b5bf51408f48f693bf75aca127b85e/users/a82ca8cb7fd3443181db1cb1889dbf22/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.866006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910803d-f721-4469-9ccc-3bf0794ae4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4b5bf51408f48f693bf75aca127b85e, user_id=a82ca8cb7fd3443181db1cb1889dbf22, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:54.868661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0910803d-f721-4469-9ccc-3bf0794ae4d6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:54.882082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1353/2691] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:54 2022] PUT /identity/v3/projects/f4b5bf51408f48f693bf75aca127b85e/users/a82ca8cb7fd3443181db1cb1889dbf22/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:54.893653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44967e51-7cbf-404e-a9fc-518768a68a8f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:54.894097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44967e51-7cbf-404e-a9fc-518768a68a8f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:54.894195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44967e51-7cbf-404e-a9fc-518768a68a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:54.921349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-44967e51-7cbf-404e-a9fc-518768a68a8f None None] MFA Rules not processed for user `a82ca8cb7fd3443181db1cb1889dbf22`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:54.922559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-44967e51-7cbf-404e-a9fc-518768a68a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:54.987422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1339/2692] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:54.991835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910803d-f721-4469-9ccc-3bf0794ae4d6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.053061 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0910803d-f721-4469-9ccc-3bf0794ae4d6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.057663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728b6f9-0656-493a-8ad7-ad6763eae092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.058271 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728b6f9-0656-493a-8ad7-ad6763eae092 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.058553 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728b6f9-0656-493a-8ad7-ad6763eae092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.058826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728b6f9-0656-493a-8ad7-ad6763eae092 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.059493 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728b6f9-0656-493a-8ad7-ad6763eae092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.062017 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f728b6f9-0656-493a-8ad7-ad6763eae092 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.071373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:55.091094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1354/2693] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:54 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:55.095759 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44967e51-7cbf-404e-a9fc-518768a68a8f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.106617 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44967e51-7cbf-404e-a9fc-518768a68a8f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.135883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:55.163100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74e4c-0b72-420f-86bf-0a5ed925dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.163706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74e4c-0b72-420f-86bf-0a5ed925dc14 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.163985 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74e4c-0b72-420f-86bf-0a5ed925dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.164287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf74e4c-0b72-420f-86bf-0a5ed925dc14 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.164957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf74e4c-0b72-420f-86bf-0a5ed925dc14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.166856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf74e4c-0b72-420f-86bf-0a5ed925dc14 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.189741 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1340/2694] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:55 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:50:55.193851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728b6f9-0656-493a-8ad7-ad6763eae092 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.204503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f728b6f9-0656-493a-8ad7-ad6763eae092 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.209163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e67c2-6c65-4ead-bae2-d287ecead01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.209772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e67c2-6c65-4ead-bae2-d287ecead01a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.210052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e67c2-6c65-4ead-bae2-d287ecead01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.210325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e67c2-6c65-4ead-bae2-d287ecead01a admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.211020 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e67c2-6c65-4ead-bae2-d287ecead01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.212639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3e67c2-6c65-4ead-bae2-d287ecead01a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.222877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1355/2695] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:55.226599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74e4c-0b72-420f-86bf-0a5ed925dc14 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.236303 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf74e4c-0b72-420f-86bf-0a5ed925dc14 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.240820 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34d11f-4795-4751-8e32-f83e78c7cd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.241417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34d11f-4795-4751-8e32-f83e78c7cd8b admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.241698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34d11f-4795-4751-8e32-f83e78c7cd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.241970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34d11f-4795-4751-8e32-f83e78c7cd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.242660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34d11f-4795-4751-8e32-f83e78c7cd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.244290 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34d11f-4795-4751-8e32-f83e78c7cd8b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.254000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1341/2696] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:55.257894 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e67c2-6c65-4ead-bae2-d287ecead01a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.268285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e67c2-6c65-4ead-bae2-d287ecead01a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.273354 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefae048-5c5e-4feb-b8d8-a7f626af8af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.274007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefae048-5c5e-4feb-b8d8-a7f626af8af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.274285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefae048-5c5e-4feb-b8d8-a7f626af8af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.274557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefae048-5c5e-4feb-b8d8-a7f626af8af3 admin admin] PATH_INFO: `/v3/projects/a54db85fa3684eae9e91a3dae5393b85/users/dd799e182ae74d1782ff0c363200fcfb/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.289490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefae048-5c5e-4feb-b8d8-a7f626af8af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54db85fa3684eae9e91a3dae5393b85, user_id=dd799e182ae74d1782ff0c363200fcfb, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.292094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefae048-5c5e-4feb-b8d8-a7f626af8af3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.304181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1356/2697] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:55 2022] PUT /identity/v3/projects/a54db85fa3684eae9e91a3dae5393b85/users/dd799e182ae74d1782ff0c363200fcfb/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:55.314132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e12b3-1a45-405b-818a-500f30bd6a2f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.314501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e12b3-1a45-405b-818a-500f30bd6a2f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.314785 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e12b3-1a45-405b-818a-500f30bd6a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.342657 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-e26e12b3-1a45-405b-818a-500f30bd6a2f None None] MFA Rules not processed for user `dd799e182ae74d1782ff0c363200fcfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:55.343851 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e26e12b3-1a45-405b-818a-500f30bd6a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:55.406875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1342/2698] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:55.411584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefae048-5c5e-4feb-b8d8-a7f626af8af3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.471303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefae048-5c5e-4feb-b8d8-a7f626af8af3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.475921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ab3bb-2abd-49ab-851d-930c2ce06b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.476562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ab3bb-2abd-49ab-851d-930c2ce06b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.476847 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ab3bb-2abd-49ab-851d-930c2ce06b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.477121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ab3bb-2abd-49ab-851d-930c2ce06b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.477779 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ab3bb-2abd-49ab-851d-930c2ce06b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.479671 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ab3bb-2abd-49ab-851d-930c2ce06b0a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.505063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1357/2699] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:50:55 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:55.509263 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e12b3-1a45-405b-818a-500f30bd6a2f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.520579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e12b3-1a45-405b-818a-500f30bd6a2f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.577768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c55a60-a1b7-49d0-9f69-dae9282c25d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.578394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c55a60-a1b7-49d0-9f69-dae9282c25d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.578678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c55a60-a1b7-49d0-9f69-dae9282c25d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.578955 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c55a60-a1b7-49d0-9f69-dae9282c25d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.579749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c55a60-a1b7-49d0-9f69-dae9282c25d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.581760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c55a60-a1b7-49d0-9f69-dae9282c25d3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.603641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1343/2700] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:50:55 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:50:55.607822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ab3bb-2abd-49ab-851d-930c2ce06b0a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.617982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ab3bb-2abd-49ab-851d-930c2ce06b0a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.623095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8d1d8-8c62-468b-9dc5-40a070f9c0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.623701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8d1d8-8c62-468b-9dc5-40a070f9c0ff admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.623985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8d1d8-8c62-468b-9dc5-40a070f9c0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.624285 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8d1d8-8c62-468b-9dc5-40a070f9c0ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.624981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8d1d8-8c62-468b-9dc5-40a070f9c0ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.626563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b8d1d8-8c62-468b-9dc5-40a070f9c0ff admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.638036 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1358/2701] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:50:55.642975 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c55a60-a1b7-49d0-9f69-dae9282c25d3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.653385 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c55a60-a1b7-49d0-9f69-dae9282c25d3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.658713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb071c-9b0a-47e5-8655-810138002ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.659414 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb071c-9b0a-47e5-8655-810138002ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.659697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb071c-9b0a-47e5-8655-810138002ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.659977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb071c-9b0a-47e5-8655-810138002ffd admin admin] PATH_INFO: `/v3/projects/db8ca6a02af544f5b642168ce710bb72/users/63821fade713476abe23d13f70f3d0da/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.675937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb071c-9b0a-47e5-8655-810138002ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8ca6a02af544f5b642168ce710bb72, user_id=63821fade713476abe23d13f70f3d0da, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.678834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb071c-9b0a-47e5-8655-810138002ffd admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.693821 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1344/2702] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:55 2022] PUT /identity/v3/projects/db8ca6a02af544f5b642168ce710bb72/users/63821fade713476abe23d13f70f3d0da/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:50:55.697667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8d1d8-8c62-468b-9dc5-40a070f9c0ff admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.710357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8d1d8-8c62-468b-9dc5-40a070f9c0ff admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.765128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dd6ed-ee74-463e-b4f0-057b6d55efc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.765741 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dd6ed-ee74-463e-b4f0-057b6d55efc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.766023 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dd6ed-ee74-463e-b4f0-057b6d55efc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.766296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dd6ed-ee74-463e-b4f0-057b6d55efc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.766987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dd6ed-ee74-463e-b4f0-057b6d55efc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.768604 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dd6ed-ee74-463e-b4f0-057b6d55efc0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.778269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1359/2703] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:50:55.782685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb071c-9b0a-47e5-8655-810138002ffd admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.792856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb071c-9b0a-47e5-8655-810138002ffd admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:55.797623 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9514fa-2355-425a-baed-2ee741e5caf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:55.798269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9514fa-2355-425a-baed-2ee741e5caf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.798557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9514fa-2355-425a-baed-2ee741e5caf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.798832 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9514fa-2355-425a-baed-2ee741e5caf9 admin admin] PATH_INFO: `/v3/projects/db8ca6a02af544f5b642168ce710bb72/users/63821fade713476abe23d13f70f3d0da/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.800830 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9514fa-2355-425a-baed-2ee741e5caf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db8ca6a02af544f5b642168ce710bb72, user_id=63821fade713476abe23d13f70f3d0da, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:55.803444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9514fa-2355-425a-baed-2ee741e5caf9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:55.805780 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:55.816796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1345/2704] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:50:55 2022] PUT /identity/v3/projects/db8ca6a02af544f5b642168ce710bb72/users/63821fade713476abe23d13f70f3d0da/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:55.828617 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3df6ba-e1f9-46c2-88b9-536224d82cd7 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:55.828900 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3df6ba-e1f9-46c2-88b9-536224d82cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:55.829171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3df6ba-e1f9-46c2-88b9-536224d82cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:55.855451 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4f3df6ba-e1f9-46c2-88b9-536224d82cd7 None None] MFA Rules not processed for user `63821fade713476abe23d13f70f3d0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:55.856692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4f3df6ba-e1f9-46c2-88b9-536224d82cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:55.868953 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:55.927871 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1360/2705] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:50:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:55.939709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9514fa-2355-425a-baed-2ee741e5caf9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:55.941512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3f9514fa-2355-425a-baed-2ee741e5caf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:56.003370 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9514fa-2355-425a-baed-2ee741e5caf9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:56.007486 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908efb35-a861-4223-a467-f3ac193db51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:56.008098 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908efb35-a861-4223-a467-f3ac193db51f service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:56.008416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908efb35-a861-4223-a467-f3ac193db51f service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:56.008689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908efb35-a861-4223-a467-f3ac193db51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:56.065257 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908efb35-a861-4223-a467-f3ac193db51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:56.066679 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908efb35-a861-4223-a467-f3ac193db51f service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:56.075590 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1346/2706] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:57.637395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3df6ba-e1f9-46c2-88b9-536224d82cd7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:57.640327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4f3df6ba-e1f9-46c2-88b9-536224d82cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:57.656510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3df6ba-e1f9-46c2-88b9-536224d82cd7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:57.662341 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a9e92-5e73-4420-ba69-d2d2de51f25a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:57.664487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a9e92-5e73-4420-ba69-d2d2de51f25a service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:57.664487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a9e92-5e73-4420-ba69-d2d2de51f25a service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:57.664487 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a9e92-5e73-4420-ba69-d2d2de51f25a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:57.744745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a9e92-5e73-4420-ba69-d2d2de51f25a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:57.746144 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a9e92-5e73-4420-ba69-d2d2de51f25a service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:57.756371 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1361/2707] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:58.415465 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908efb35-a861-4223-a467-f3ac193db51f service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:58.424977 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908efb35-a861-4223-a467-f3ac193db51f service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:58.428893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862e68-ed24-41d2-9ca3-934147f40e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:58.429688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862e68-ed24-41d2-9ca3-934147f40e49 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:58.429973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862e68-ed24-41d2-9ca3-934147f40e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:58.430248 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48862e68-ed24-41d2-9ca3-934147f40e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:58.440491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48862e68-ed24-41d2-9ca3-934147f40e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:58.441936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48862e68-ed24-41d2-9ca3-934147f40e49 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:58.452472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1347/2708] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:51:01.525550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a9e92-5e73-4420-ba69-d2d2de51f25a service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:01.527346 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b73a9e92-5e73-4420-ba69-d2d2de51f25a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:01.588700 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a9e92-5e73-4420-ba69-d2d2de51f25a service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:01.593357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf56629-ec26-4ac4-8c7a-6649cfb44c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:01.593965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf56629-ec26-4ac4-8c7a-6649cfb44c16 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:01.594241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf56629-ec26-4ac4-8c7a-6649cfb44c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:01.594510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf56629-ec26-4ac4-8c7a-6649cfb44c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:01.596283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-cbf56629-ec26-4ac4-8c7a-6649cfb44c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:01.663246 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf56629-ec26-4ac4-8c7a-6649cfb44c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:01.664739 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf56629-ec26-4ac4-8c7a-6649cfb44c16 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:01.668656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:01.676227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1362/2709] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:51:02.430449 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862e68-ed24-41d2-9ca3-934147f40e49 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:02.440929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48862e68-ed24-41d2-9ca3-934147f40e49 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:02.445466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:02.446097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:02.446381 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:02.446660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] PATH_INFO: `/v3/users/a82ca8cb7fd3443181db1cb1889dbf22` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:02.447918 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82ca8cb7fd3443181db1cb1889dbf22)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:02.449875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:02.499891 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82ca8cb7fd3443181db1cb1889dbf22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:02.507514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82ca8cb7fd3443181db1cb1889dbf22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:02.517318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82ca8cb7fd3443181db1cb1889dbf22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:02.518015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82ca8cb7fd3443181db1cb1889dbf22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:02.518791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82ca8cb7fd3443181db1cb1889dbf22'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:02.537983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1348/2710] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:02 2022] DELETE /identity/v3/users/a82ca8cb7fd3443181db1cb1889dbf22 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:02.542640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44287e-6c9b-4e1f-8a35-2a0a9e7eaab4 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:02.543122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44287e-6c9b-4e1f-8a35-2a0a9e7eaab4 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:02.543394 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44287e-6c9b-4e1f-8a35-2a0a9e7eaab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:02.563485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1f44287e-6c9b-4e1f-8a35-2a0a9e7eaab4 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:02.564733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1f44287e-6c9b-4e1f-8a35-2a0a9e7eaab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:02.645581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1363/2711] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:02.653165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:02.655502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:02.667403 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:02.729566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ba36f-bd06-491b-a28a-f386a7a06add admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:02.733857 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493988ed-08a9-4a13-862e-cd6e04f87200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:02.734605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493988ed-08a9-4a13-862e-cd6e04f87200 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:02.734968 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493988ed-08a9-4a13-862e-cd6e04f87200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:02.735319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493988ed-08a9-4a13-862e-cd6e04f87200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:02.745674 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493988ed-08a9-4a13-862e-cd6e04f87200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:02.747410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493988ed-08a9-4a13-862e-cd6e04f87200 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:02.758616 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1349/2712] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:03.065233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44287e-6c9b-4e1f-8a35-2a0a9e7eaab4 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:03.067039 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1f44287e-6c9b-4e1f-8a35-2a0a9e7eaab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:03.079248 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44287e-6c9b-4e1f-8a35-2a0a9e7eaab4 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:03.090315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:03.091567 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:03.091796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:03.092068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] PATH_INFO: `/v3/projects/f4b5bf51408f48f693bf75aca127b85e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:03.093292 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4b5bf51408f48f693bf75aca127b85e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:03.095224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:03.146790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4b5bf51408f48f693bf75aca127b85e', 'request_id': 'req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.154538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4b5bf51408f48f693bf75aca127b85e', 'request_id': 'req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.162393 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4b5bf51408f48f693bf75aca127b85e', 'request_id': 'req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.174681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] The token cache is being invalidate because project f4b5bf51408f48f693bf75aca127b85e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:03.174967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.175588 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.177105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1364/2713] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:03 2022] DELETE /identity/v3/projects/f4b5bf51408f48f693bf75aca127b85e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:03.181539 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493988ed-08a9-4a13-862e-cd6e04f87200 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:03.191502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493988ed-08a9-4a13-862e-cd6e04f87200 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:03.247745 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:03.248409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:03.248690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:03.248965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] PATH_INFO: `/v3/users/dd799e182ae74d1782ff0c363200fcfb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:03.250124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd799e182ae74d1782ff0c363200fcfb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:03.252024 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:03.298802 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd799e182ae74d1782ff0c363200fcfb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.306094 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd799e182ae74d1782ff0c363200fcfb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.314054 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd799e182ae74d1782ff0c363200fcfb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.314800 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd799e182ae74d1782ff0c363200fcfb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.315424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd799e182ae74d1782ff0c363200fcfb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.337813 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1350/2714] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:03 2022] DELETE /identity/v3/users/dd799e182ae74d1782ff0c363200fcfb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:03.787500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:03.789134 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:03.805982 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3d5a9-acb1-4b09-adbe-6323ba01b2c8 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:03.874489 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:03.875166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:03.875514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:03.875853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] PATH_INFO: `/v3/projects/a54db85fa3684eae9e91a3dae5393b85` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:03.877196 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54db85fa3684eae9e91a3dae5393b85)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:03.879265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:03.908452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:03.956019 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54db85fa3684eae9e91a3dae5393b85', 'request_id': 'req-7bae61ee-62d9-4ec6-b975-e5df70452d0e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.965529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54db85fa3684eae9e91a3dae5393b85', 'request_id': 'req-7bae61ee-62d9-4ec6-b975-e5df70452d0e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.980720 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54db85fa3684eae9e91a3dae5393b85', 'request_id': 'req-7bae61ee-62d9-4ec6-b975-e5df70452d0e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.997901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] The token cache is being invalidate because project a54db85fa3684eae9e91a3dae5393b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:03.998485 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:03.999218 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.004219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1365/2715] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:03 2022] DELETE /identity/v3/projects/a54db85fa3684eae9e91a3dae5393b85 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:04.009287 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:04.019637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:04.041747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be5569-d153-476e-86f5-f66de1d965a5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:04.121476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:04.174342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:04.175397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.175764 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.176110 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] PATH_INFO: `/v3/users/63821fade713476abe23d13f70f3d0da` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.177514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] RBAC: Authorizing `identity:delete_user(user_id=63821fade713476abe23d13f70f3d0da)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:04.180779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:04.244604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63821fade713476abe23d13f70f3d0da'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.256653 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63821fade713476abe23d13f70f3d0da'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.266886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63821fade713476abe23d13f70f3d0da'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.267681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63821fade713476abe23d13f70f3d0da'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.268583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9f72e4a7-4b13-4ea6-9d91-588bf18efbad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63821fade713476abe23d13f70f3d0da'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.291167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1351/2716] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:04 2022] DELETE /identity/v3/users/63821fade713476abe23d13f70f3d0da => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:04.631853 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:04.633329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:04.649723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae61ee-62d9-4ec6-b975-e5df70452d0e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:04.717168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:04.719158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.719764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.720296 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] PATH_INFO: `/v3/projects/db8ca6a02af544f5b642168ce710bb72` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.722283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db8ca6a02af544f5b642168ce710bb72)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:04.725344 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:04.785575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db8ca6a02af544f5b642168ce710bb72', 'request_id': 'req-18c53e15-8663-45eb-838e-be3406bd8261'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.800508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db8ca6a02af544f5b642168ce710bb72', 'request_id': 'req-18c53e15-8663-45eb-838e-be3406bd8261'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.812045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db8ca6a02af544f5b642168ce710bb72', 'request_id': 'req-18c53e15-8663-45eb-838e-be3406bd8261'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.826409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] The token cache is being invalidate because project db8ca6a02af544f5b642168ce710bb72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:04.826715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.827363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-18c53e15-8663-45eb-838e-be3406bd8261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:04.829748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1366/2717] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:04 2022] DELETE /identity/v3/projects/db8ca6a02af544f5b642168ce710bb72 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:04.836090 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e40009-99c2-4294-a955-69d895970cb7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.836426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e40009-99c2-4294-a955-69d895970cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.836704 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e40009-99c2-4294-a955-69d895970cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.856610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-26e40009-99c2-4294-a955-69d895970cb7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:04.858457 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-26e40009-99c2-4294-a955-69d895970cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:04.941660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1352/2718] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:51:04.949776 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dc725-25e3-4035-ba6f-56084b72d09d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.949986 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dc725-25e3-4035-ba6f-56084b72d09d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.950263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dc725-25e3-4035-ba6f-56084b72d09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.971052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-190dc725-25e3-4035-ba6f-56084b72d09d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:04.972301 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-190dc725-25e3-4035-ba6f-56084b72d09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:04.987985 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1367/2719] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:04.999717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e40009-99c2-4294-a955-69d895970cb7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:05.012716 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e40009-99c2-4294-a955-69d895970cb7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:05.032387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1703-d8a2-4b90-945b-690a811aad08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:05.033363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1703-d8a2-4b90-945b-690a811aad08 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.033834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1703-d8a2-4b90-945b-690a811aad08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.034544 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f1703-d8a2-4b90-945b-690a811aad08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.035500 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1703-d8a2-4b90-945b-690a811aad08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:51:05.036012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1703-d8a2-4b90-945b-690a811aad08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:05.038751 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f1703-d8a2-4b90-945b-690a811aad08 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:05.068084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1353/2720] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:51:05.076123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dc725-25e3-4035-ba6f-56084b72d09d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:05.102580 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dc725-25e3-4035-ba6f-56084b72d09d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:05.111751 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4df1-902f-46b0-ac59-84d16ad12c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:05.112819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4df1-902f-46b0-ac59-84d16ad12c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.113298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4df1-902f-46b0-ac59-84d16ad12c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.113920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4df1-902f-46b0-ac59-84d16ad12c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.115136 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f4df1-902f-46b0-ac59-84d16ad12c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:05.118632 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f4df1-902f-46b0-ac59-84d16ad12c8b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:05.192423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1368/2721] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:51:05 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:05.195887 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1703-d8a2-4b90-945b-690a811aad08 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:05.214342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f1703-d8a2-4b90-945b-690a811aad08 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:05.291568 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:05.341875 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce34c1-df5f-4e62-a4cd-c1cf9fe9fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:05.342838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce34c1-df5f-4e62-a4cd-c1cf9fe9fd68 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.343436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce34c1-df5f-4e62-a4cd-c1cf9fe9fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.343933 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce34c1-df5f-4e62-a4cd-c1cf9fe9fd68 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.345496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce34c1-df5f-4e62-a4cd-c1cf9fe9fd68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:05.347816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce34c1-df5f-4e62-a4cd-c1cf9fe9fd68 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:05.381503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1354/2722] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:51:05 2022] POST /identity/v3/users => generated 283 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:05.392320 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4df1-902f-46b0-ac59-84d16ad12c8b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:05.412089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4df1-902f-46b0-ac59-84d16ad12c8b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:05.420297 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff925-a0e1-4100-a840-bd3c04131cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:05.421234 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff925-a0e1-4100-a840-bd3c04131cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.421688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff925-a0e1-4100-a840-bd3c04131cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.422128 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ff925-a0e1-4100-a840-bd3c04131cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.423356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ff925-a0e1-4100-a840-bd3c04131cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:05.426540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7ff925-a0e1-4100-a840-bd3c04131cf0 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:05.448305 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1369/2723] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:51:05.452026 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce34c1-df5f-4e62-a4cd-c1cf9fe9fd68 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:05.452838 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff925-a0e1-4100-a840-bd3c04131cf0 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:05.455260 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-14ce34c1-df5f-4e62-a4cd-c1cf9fe9fd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:05.459018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:05.464883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7ff925-a0e1-4100-a840-bd3c04131cf0 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:05.473885 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f7f87-61e0-4cb7-b405-9993aa755f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:05.475069 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f7f87-61e0-4cb7-b405-9993aa755f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.475644 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f7f87-61e0-4cb7-b405-9993aa755f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.476505 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f7f87-61e0-4cb7-b405-9993aa755f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.476953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce34c1-df5f-4e62-a4cd-c1cf9fe9fd68 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:05.477519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f7f87-61e0-4cb7-b405-9993aa755f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:05.479345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f7f87-61e0-4cb7-b405-9993aa755f42 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:05.482531 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:05.483530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.483530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.483749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] PATH_INFO: `/v3/users/57e8eced4d8d49458668a52761e9b8bb` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.485052 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e8eced4d8d49458668a52761e9b8bb)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:05.486989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:05.494207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1370/2724] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:05.498568 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f7f87-61e0-4cb7-b405-9993aa755f42 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:05.508558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f7f87-61e0-4cb7-b405-9993aa755f42 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:05.517378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6893f4-f215-4975-a493-58f292e52742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:05.518198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6893f4-f215-4975-a493-58f292e52742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.518468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6893f4-f215-4975-a493-58f292e52742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.518709 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6893f4-f215-4975-a493-58f292e52742 admin admin] PATH_INFO: `/v3/projects/fc7422bd6cc34b35938c6581b97a54f2/users/9eb144b706484316b177bfc9690444d7/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.543663 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6893f4-f215-4975-a493-58f292e52742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc7422bd6cc34b35938c6581b97a54f2, user_id=9eb144b706484316b177bfc9690444d7, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:05.547166 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6893f4-f215-4975-a493-58f292e52742 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:05.556010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e8eced4d8d49458668a52761e9b8bb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.562366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1371/2725] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:05 2022] PUT /identity/v3/projects/fc7422bd6cc34b35938c6581b97a54f2/users/9eb144b706484316b177bfc9690444d7/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:05.564824 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e8eced4d8d49458668a52761e9b8bb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.577048 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f602-d201-4b4e-b363-d3da793867be None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.577304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f602-d201-4b4e-b363-d3da793867be None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.577620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f602-d201-4b4e-b363-d3da793867be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.579594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e8eced4d8d49458668a52761e9b8bb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.580697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e8eced4d8d49458668a52761e9b8bb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.581424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e8eced4d8d49458668a52761e9b8bb'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.603860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1355/2726] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:05 2022] DELETE /identity/v3/users/57e8eced4d8d49458668a52761e9b8bb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:05.608764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f322f602-d201-4b4e-b363-d3da793867be None None] MFA Rules not processed for user `9eb144b706484316b177bfc9690444d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:05.610038 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f322f602-d201-4b4e-b363-d3da793867be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:05.716311 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1372/2727] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:51:05.733489 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:05.734952 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:05.818350 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f66c1c-daa4-4cda-baad-99f3812fe501 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:05.819804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322f602-d201-4b4e-b363-d3da793867be None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:05.821813 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f322f602-d201-4b4e-b363-d3da793867be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:05.822829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2bf60-cfd9-4e6e-b487-69be5c507f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:05.823455 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2bf60-cfd9-4e6e-b487-69be5c507f6c service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.823737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2bf60-cfd9-4e6e-b487-69be5c507f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.824013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2bf60-cfd9-4e6e-b487-69be5c507f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.833728 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2bf60-cfd9-4e6e-b487-69be5c507f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:05.835176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee2bf60-cfd9-4e6e-b487-69be5c507f6c service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:05.844638 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1356/2728] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:05.894667 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322f602-d201-4b4e-b363-d3da793867be None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:05.899722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:05.900715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:05.901114 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:05.901476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] PATH_INFO: `/v3/projects/522def96635b48a59492fb7083c3c842` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:05.903103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522def96635b48a59492fb7083c3c842)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:05.905345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:05.959574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522def96635b48a59492fb7083c3c842', 'request_id': 'req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.965702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522def96635b48a59492fb7083c3c842', 'request_id': 'req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.971179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:05.977068 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522def96635b48a59492fb7083c3c842', 'request_id': 'req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.994353 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] The token cache is being invalidate because project 522def96635b48a59492fb7083c3c842 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:05.994721 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.995423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-442ea2b4-7b78-4a27-92d2-0bd47bfffe25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:05.997343 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1373/2729] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:05 2022] DELETE /identity/v3/projects/522def96635b48a59492fb7083c3c842 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:51:06.002771 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec468a-b9ed-4ee3-8854-76d08827d5ba None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.002932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec468a-b9ed-4ee3-8854-76d08827d5ba None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.003221 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec468a-b9ed-4ee3-8854-76d08827d5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.028947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-c3ec468a-b9ed-4ee3-8854-76d08827d5ba None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:06.030182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c3ec468a-b9ed-4ee3-8854-76d08827d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:06.075164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:06.114162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1357/2730] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:06.123056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee869fe-a00e-40a6-a253-c6d929ab2d4d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.123488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee869fe-a00e-40a6-a253-c6d929ab2d4d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.123840 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee869fe-a00e-40a6-a253-c6d929ab2d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.151026 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-eee869fe-a00e-40a6-a253-c6d929ab2d4d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:06.151390 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-eee869fe-a00e-40a6-a253-c6d929ab2d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:06.162606 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1374/2731] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:51:06.169155 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec468a-b9ed-4ee3-8854-76d08827d5ba None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:06.189717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec468a-b9ed-4ee3-8854-76d08827d5ba None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:06.196113 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fddeb0-b7f3-43dd-9098-7a84033363bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:06.197108 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fddeb0-b7f3-43dd-9098-7a84033363bf admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.197547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fddeb0-b7f3-43dd-9098-7a84033363bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.197978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fddeb0-b7f3-43dd-9098-7a84033363bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.199096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fddeb0-b7f3-43dd-9098-7a84033363bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:51:06.199580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fddeb0-b7f3-43dd-9098-7a84033363bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:06.201715 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fddeb0-b7f3-43dd-9098-7a84033363bf admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:06.217990 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1358/2732] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:51:06.222483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee869fe-a00e-40a6-a253-c6d929ab2d4d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:06.233083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee869fe-a00e-40a6-a253-c6d929ab2d4d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:06.238112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c23786-ca04-498a-b857-3da094c5f50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:06.238112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c23786-ca04-498a-b857-3da094c5f50b admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.238112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c23786-ca04-498a-b857-3da094c5f50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.239388 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c23786-ca04-498a-b857-3da094c5f50b admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.240355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c23786-ca04-498a-b857-3da094c5f50b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:06.242323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c23786-ca04-498a-b857-3da094c5f50b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:06.270584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1375/2733] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:51:06 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:06.274928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fddeb0-b7f3-43dd-9098-7a84033363bf admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:06.285588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fddeb0-b7f3-43dd-9098-7a84033363bf admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:06.341078 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1830c4-6eb7-47e1-b3c8-63c9a0ceb76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:06.341676 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1830c4-6eb7-47e1-b3c8-63c9a0ceb76e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.341954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1830c4-6eb7-47e1-b3c8-63c9a0ceb76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.342226 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1830c4-6eb7-47e1-b3c8-63c9a0ceb76e admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.342879 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1830c4-6eb7-47e1-b3c8-63c9a0ceb76e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:06.344812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1830c4-6eb7-47e1-b3c8-63c9a0ceb76e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:06.365058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1359/2734] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:51:06 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:06.369185 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c23786-ca04-498a-b857-3da094c5f50b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:06.379810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c23786-ca04-498a-b857-3da094c5f50b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:06.384376 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f53121-4146-4091-93de-d6689b9fa85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:06.384976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53121-4146-4091-93de-d6689b9fa85c admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.385260 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53121-4146-4091-93de-d6689b9fa85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.385611 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f53121-4146-4091-93de-d6689b9fa85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.386304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f53121-4146-4091-93de-d6689b9fa85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:06.387890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f53121-4146-4091-93de-d6689b9fa85c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:06.399027 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1376/2735] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:06.403169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1830c4-6eb7-47e1-b3c8-63c9a0ceb76e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:06.412899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1830c4-6eb7-47e1-b3c8-63c9a0ceb76e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:06.417368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4342e7-159f-48cb-b172-e6fe7e71f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:06.417960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4342e7-159f-48cb-b172-e6fe7e71f66e admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.418235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4342e7-159f-48cb-b172-e6fe7e71f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.418502 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4342e7-159f-48cb-b172-e6fe7e71f66e admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.419206 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4342e7-159f-48cb-b172-e6fe7e71f66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:06.420844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4342e7-159f-48cb-b172-e6fe7e71f66e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:06.431207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1360/2736] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:06.435827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f53121-4146-4091-93de-d6689b9fa85c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:06.445669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f53121-4146-4091-93de-d6689b9fa85c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:06.451601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a58901-88d7-4378-b117-c25c4816ea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:06.452322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a58901-88d7-4378-b117-c25c4816ea94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.452601 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a58901-88d7-4378-b117-c25c4816ea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.452872 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a58901-88d7-4378-b117-c25c4816ea94 admin admin] PATH_INFO: `/v3/projects/fd0eadd009854271ad1ba5f6fab80a48/users/ab54211034084290a723fa241a901cd8/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.469099 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a58901-88d7-4378-b117-c25c4816ea94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd0eadd009854271ad1ba5f6fab80a48, user_id=ab54211034084290a723fa241a901cd8, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:06.472123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a58901-88d7-4378-b117-c25c4816ea94 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:06.486526 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1377/2737] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:06 2022] PUT /identity/v3/projects/fd0eadd009854271ad1ba5f6fab80a48/users/ab54211034084290a723fa241a901cd8/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:06.491658 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cc953-d164-45d8-b6ee-62a661c94e80 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.491912 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cc953-d164-45d8-b6ee-62a661c94e80 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.492211 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cc953-d164-45d8-b6ee-62a661c94e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.512444 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-272cc953-d164-45d8-b6ee-62a661c94e80 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:06.513660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-272cc953-d164-45d8-b6ee-62a661c94e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:06.571229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1361/2738] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:06.580848 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a58901-88d7-4378-b117-c25c4816ea94 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:06.582550 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-a5a58901-88d7-4378-b117-c25c4816ea94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:06.639434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a58901-88d7-4378-b117-c25c4816ea94 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:06.643373 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bf912-5015-4cda-a973-eec3d53acb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:06.643995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bf912-5015-4cda-a973-eec3d53acb8c service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:06.644321 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bf912-5015-4cda-a973-eec3d53acb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:06.644595 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bf912-5015-4cda-a973-eec3d53acb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:06.656275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bf912-5015-4cda-a973-eec3d53acb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:06.657722 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bf912-5015-4cda-a973-eec3d53acb8c service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:06.667179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1378/2739] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:07.308016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79363c-4853-450c-b938-b139ca9680c6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:07.308614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79363c-4853-450c-b938-b139ca9680c6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:07.308614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79363c-4853-450c-b938-b139ca9680c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:07.351174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-af79363c-4853-450c-b938-b139ca9680c6 None None] MFA Rules not processed for user `ab54211034084290a723fa241a901cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:07.353355 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-af79363c-4853-450c-b938-b139ca9680c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:07.398008 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:07.444382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1362/2740] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:07 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:07.449404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bf912-5015-4cda-a973-eec3d53acb8c service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:07.460718 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bf912-5015-4cda-a973-eec3d53acb8c service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:07.469652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434054-4a4a-498b-b948-eafd1c48f7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:07.469967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434054-4a4a-498b-b948-eafd1c48f7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:07.470328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434054-4a4a-498b-b948-eafd1c48f7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:07.470677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95434054-4a4a-498b-b948-eafd1c48f7a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:07.471448 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434054-4a4a-498b-b948-eafd1c48f7a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:07.473476 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95434054-4a4a-498b-b948-eafd1c48f7a6 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:07.520193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1379/2741] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:51:07 2022] POST /identity/v3/projects => generated 403 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:51:07.527474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79363c-4853-450c-b938-b139ca9680c6 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:07.552058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79363c-4853-450c-b938-b139ca9680c6 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:07.617338 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab6ed-28dc-4d74-875b-b0a4564e774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:07.617954 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab6ed-28dc-4d74-875b-b0a4564e774c admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:07.618236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab6ed-28dc-4d74-875b-b0a4564e774c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:07.618509 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dab6ed-28dc-4d74-875b-b0a4564e774c admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:07.619170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dab6ed-28dc-4d74-875b-b0a4564e774c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:07.621111 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dab6ed-28dc-4d74-875b-b0a4564e774c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:07.645015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1363/2742] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:51:07 2022] POST /identity/v3/users => generated 308 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:07.649325 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434054-4a4a-498b-b948-eafd1c48f7a6 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:07.661097 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95434054-4a4a-498b-b948-eafd1c48f7a6 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:07.666471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bdeab-5f95-46ca-9c2b-27da9a1be561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:07.667215 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bdeab-5f95-46ca-9c2b-27da9a1be561 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:07.667621 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bdeab-5f95-46ca-9c2b-27da9a1be561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:07.667892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bdeab-5f95-46ca-9c2b-27da9a1be561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:07.668634 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bdeab-5f95-46ca-9c2b-27da9a1be561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:07.670361 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bdeab-5f95-46ca-9c2b-27da9a1be561 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:07.685929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1380/2743] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:07.692173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab6ed-28dc-4d74-875b-b0a4564e774c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:07.703581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dab6ed-28dc-4d74-875b-b0a4564e774c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:07.709621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434e910-b439-48fb-a3a7-c508c0dbdcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:07.710458 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e910-b439-48fb-a3a7-c508c0dbdcb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:07.710750 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e910-b439-48fb-a3a7-c508c0dbdcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:07.711133 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434e910-b439-48fb-a3a7-c508c0dbdcb4 admin admin] PATH_INFO: `/v3/projects/3e59a64046a94168a732e062515e4e31/users/00587411deb64ffb9185738f9312cacc/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:07.729542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434e910-b439-48fb-a3a7-c508c0dbdcb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e59a64046a94168a732e062515e4e31, user_id=00587411deb64ffb9185738f9312cacc, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:07.733114 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7434e910-b439-48fb-a3a7-c508c0dbdcb4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:07.747794 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1364/2744] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:07 2022] PUT /identity/v3/projects/3e59a64046a94168a732e062515e4e31/users/00587411deb64ffb9185738f9312cacc/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:07.752474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bdeab-5f95-46ca-9c2b-27da9a1be561 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:07.765780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bdeab-5f95-46ca-9c2b-27da9a1be561 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:07.845525 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:07.864408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520c911-a673-4260-a75c-8a7666b11a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:07.866056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c911-a673-4260-a75c-8a7666b11a0e admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:07.873123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c911-a673-4260-a75c-8a7666b11a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:07.873366 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c911-a673-4260-a75c-8a7666b11a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:07.874579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520c911-a673-4260-a75c-8a7666b11a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:07.876401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d520c911-a673-4260-a75c-8a7666b11a0e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:07.888560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1381/2745] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:07.894504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434e910-b439-48fb-a3a7-c508c0dbdcb4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:07.911364 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434e910-b439-48fb-a3a7-c508c0dbdcb4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:07.919149 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8a76-9265-4845-9b41-f55edff31c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:07.920656 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8a76-9265-4845-9b41-f55edff31c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:07.921158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8a76-9265-4845-9b41-f55edff31c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:07.922084 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8a76-9265-4845-9b41-f55edff31c09 admin admin] PATH_INFO: `/v3/projects/3e59a64046a94168a732e062515e4e31/users/00587411deb64ffb9185738f9312cacc/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:07.924706 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca8a76-9265-4845-9b41-f55edff31c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e59a64046a94168a732e062515e4e31, user_id=00587411deb64ffb9185738f9312cacc, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:07.927348 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca8a76-9265-4845-9b41-f55edff31c09 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:07.941314 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1365/2746] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:07 2022] PUT /identity/v3/projects/3e59a64046a94168a732e062515e4e31/users/00587411deb64ffb9185738f9312cacc/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:08.591819 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be80e0-92cf-4401-a1c5-43030da98cff None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:08.592417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be80e0-92cf-4401-a1c5-43030da98cff None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:08.592417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7be80e0-92cf-4401-a1c5-43030da98cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:08.623228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b7be80e0-92cf-4401-a1c5-43030da98cff None None] MFA Rules not processed for user `00587411deb64ffb9185738f9312cacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:08.624830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b7be80e0-92cf-4401-a1c5-43030da98cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:08.705239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1382/2747] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:08 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:51:09.751343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8a76-9265-4845-9b41-f55edff31c09 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:09.815325 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8a76-9265-4845-9b41-f55edff31c09 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:09.819996 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:09.820661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:09.820944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:09.821219 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] PATH_INFO: `/v3/users/ab54211034084290a723fa241a901cd8` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:09.822394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab54211034084290a723fa241a901cd8)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:09.824386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:09.858420 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:09.872738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab54211034084290a723fa241a901cd8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:09.879631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab54211034084290a723fa241a901cd8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:09.886986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab54211034084290a723fa241a901cd8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:09.887749 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab54211034084290a723fa241a901cd8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:09.888419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab54211034084290a723fa241a901cd8'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:09.906468 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1366/2748] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:09 2022] DELETE /identity/v3/users/ab54211034084290a723fa241a901cd8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:10.083474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be80e0-92cf-4401-a1c5-43030da98cff None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:10.094914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7be80e0-92cf-4401-a1c5-43030da98cff None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:10.175600 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:10.176630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:10.177066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:10.177575 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] PATH_INFO: `/v3/projects/fd0eadd009854271ad1ba5f6fab80a48` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:10.179102 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd0eadd009854271ad1ba5f6fab80a48)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:10.181695 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:10.245895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd0eadd009854271ad1ba5f6fab80a48', 'request_id': 'req-196cd1fa-4278-4c45-9e85-d70b13eaef66'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.264288 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd0eadd009854271ad1ba5f6fab80a48', 'request_id': 'req-196cd1fa-4278-4c45-9e85-d70b13eaef66'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.272482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd0eadd009854271ad1ba5f6fab80a48', 'request_id': 'req-196cd1fa-4278-4c45-9e85-d70b13eaef66'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.282976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] The token cache is being invalidate because project fd0eadd009854271ad1ba5f6fab80a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:10.283266 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.283915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.285465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1383/2749] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:10 2022] DELETE /identity/v3/projects/fd0eadd009854271ad1ba5f6fab80a48 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:10.289454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:10.290873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:10.305530 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1272f-62b9-44ee-a536-c27b0f045a89 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:10.362342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:10.362991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:10.363271 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:10.363575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] PATH_INFO: `/v3/users/00587411deb64ffb9185738f9312cacc` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:10.364773 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=00587411deb64ffb9185738f9312cacc)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:10.366715 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:10.418671 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00587411deb64ffb9185738f9312cacc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.425984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00587411deb64ffb9185738f9312cacc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.437382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00587411deb64ffb9185738f9312cacc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.438192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00587411deb64ffb9185738f9312cacc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.438922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-831f0ea3-15f0-4341-a6de-703807f3fa6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00587411deb64ffb9185738f9312cacc'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.459805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1367/2750] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:10 2022] DELETE /identity/v3/users/00587411deb64ffb9185738f9312cacc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:10.649742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:10.651689 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:10.661164 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:10.666724 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cd1fa-4278-4c45-9e85-d70b13eaef66 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:10.726713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:10.727357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:10.727638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:10.727912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] PATH_INFO: `/v3/projects/3e59a64046a94168a732e062515e4e31` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:10.729122 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e59a64046a94168a732e062515e4e31)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:10.731030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:10.776103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e59a64046a94168a732e062515e4e31', 'request_id': 'req-3ff5dd07-8ec0-4b51-9459-824b45857026'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.782854 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e59a64046a94168a732e062515e4e31', 'request_id': 'req-3ff5dd07-8ec0-4b51-9459-824b45857026'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.790219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e59a64046a94168a732e062515e4e31', 'request_id': 'req-3ff5dd07-8ec0-4b51-9459-824b45857026'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.801360 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] The token cache is being invalidate because project 3e59a64046a94168a732e062515e4e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:10.801651 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.802330 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3ff5dd07-8ec0-4b51-9459-824b45857026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:10.803832 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1384/2751] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:10 2022] DELETE /identity/v3/projects/3e59a64046a94168a732e062515e4e31 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:10.808681 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a14454-8b33-49f5-8de4-940e2dadb8fe None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:10.809173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a14454-8b33-49f5-8de4-940e2dadb8fe None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:10.809424 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a14454-8b33-49f5-8de4-940e2dadb8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:10.829466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-46a14454-8b33-49f5-8de4-940e2dadb8fe None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:10.830662 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-46a14454-8b33-49f5-8de4-940e2dadb8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:10.850673 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:10.891277 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1368/2752] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:10.899224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c799a2-4871-4a45-87e7-971e718d4458 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:10.899510 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c799a2-4871-4a45-87e7-971e718d4458 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:10.899787 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c799a2-4871-4a45-87e7-971e718d4458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:10.921175 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-53c799a2-4871-4a45-87e7-971e718d4458 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:10.922379 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-53c799a2-4871-4a45-87e7-971e718d4458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:10.931877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1385/2753] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:10.936182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a14454-8b33-49f5-8de4-940e2dadb8fe None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:10.945905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a14454-8b33-49f5-8de4-940e2dadb8fe None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:10.950915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1b5e6-0bd6-45e2-a9fa-807dc5255b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:10.951490 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1b5e6-0bd6-45e2-a9fa-807dc5255b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:10.951765 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1b5e6-0bd6-45e2-a9fa-807dc5255b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:10.952032 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1b5e6-0bd6-45e2-a9fa-807dc5255b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:10.952748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1b5e6-0bd6-45e2-a9fa-807dc5255b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:51:10.953047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1b5e6-0bd6-45e2-a9fa-807dc5255b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:10.954607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1b5e6-0bd6-45e2-a9fa-807dc5255b6a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:10.966991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1369/2754] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:51:10.971396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c799a2-4871-4a45-87e7-971e718d4458 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:10.980571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c799a2-4871-4a45-87e7-971e718d4458 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:10.985395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebb21f-bac7-4e17-b3ed-2d3340fd52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:10.985999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebb21f-bac7-4e17-b3ed-2d3340fd52ec admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:10.986276 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebb21f-bac7-4e17-b3ed-2d3340fd52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:10.986545 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebb21f-bac7-4e17-b3ed-2d3340fd52ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:10.987225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebb21f-bac7-4e17-b3ed-2d3340fd52ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:10.989439 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebb21f-bac7-4e17-b3ed-2d3340fd52ec admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.015701 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1386/2755] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:51:10 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:11.020078 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1b5e6-0bd6-45e2-a9fa-807dc5255b6a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.030987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1b5e6-0bd6-45e2-a9fa-807dc5255b6a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.085633 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6173a-8046-4aac-ad5c-fdc425f6266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.086247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6173a-8046-4aac-ad5c-fdc425f6266f admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.086529 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6173a-8046-4aac-ad5c-fdc425f6266f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.086806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6173a-8046-4aac-ad5c-fdc425f6266f admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.087479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6173a-8046-4aac-ad5c-fdc425f6266f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.089417 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6173a-8046-4aac-ad5c-fdc425f6266f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.109889 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1370/2756] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:51:11 2022] POST /identity/v3/users => generated 281 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:11.114278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebb21f-bac7-4e17-b3ed-2d3340fd52ec admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.124426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebb21f-bac7-4e17-b3ed-2d3340fd52ec admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.129076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322767c-8c3b-4ad9-99ee-254a51c3da4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.129825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322767c-8c3b-4ad9-99ee-254a51c3da4d admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.130109 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322767c-8c3b-4ad9-99ee-254a51c3da4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.130381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322767c-8c3b-4ad9-99ee-254a51c3da4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.131075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322767c-8c3b-4ad9-99ee-254a51c3da4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.132698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322767c-8c3b-4ad9-99ee-254a51c3da4d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.143267 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1387/2757] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:11.147445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6173a-8046-4aac-ad5c-fdc425f6266f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.158119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6173a-8046-4aac-ad5c-fdc425f6266f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.162801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d9900-29b4-472a-8918-0d8374a230d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.163409 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9900-29b4-472a-8918-0d8374a230d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.163692 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9900-29b4-472a-8918-0d8374a230d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.163994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d9900-29b4-472a-8918-0d8374a230d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.164757 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9900-29b4-472a-8918-0d8374a230d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.166353 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d9900-29b4-472a-8918-0d8374a230d2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.177027 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1371/2758] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:11.181094 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322767c-8c3b-4ad9-99ee-254a51c3da4d admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.191056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322767c-8c3b-4ad9-99ee-254a51c3da4d admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.195698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e82ed-e0df-4235-a6fe-5ea57197bcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.196499 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e82ed-e0df-4235-a6fe-5ea57197bcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.196743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e82ed-e0df-4235-a6fe-5ea57197bcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.197054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e82ed-e0df-4235-a6fe-5ea57197bcf3 admin admin] PATH_INFO: `/v3/projects/4795bc0adce449c6961dfd6c3c86c9a7/users/63da837f6f20411cbfbcce4d8bff6db7/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.211661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e82ed-e0df-4235-a6fe-5ea57197bcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4795bc0adce449c6961dfd6c3c86c9a7, user_id=63da837f6f20411cbfbcce4d8bff6db7, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.214324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e82ed-e0df-4235-a6fe-5ea57197bcf3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.227851 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1388/2759] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:11 2022] PUT /identity/v3/projects/4795bc0adce449c6961dfd6c3c86c9a7/users/63da837f6f20411cbfbcce4d8bff6db7/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:11.239262 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf1b0-69fc-4d37-9ff7-b26e832c8dfc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.239549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf1b0-69fc-4d37-9ff7-b26e832c8dfc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.239828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcf1b0-69fc-4d37-9ff7-b26e832c8dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.267808 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-f1dcf1b0-69fc-4d37-9ff7-b26e832c8dfc None None] MFA Rules not processed for user `63da837f6f20411cbfbcce4d8bff6db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:11.269055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f1dcf1b0-69fc-4d37-9ff7-b26e832c8dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:11.334567 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1372/2760] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:11.339183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e82ed-e0df-4235-a6fe-5ea57197bcf3 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.373930 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:11.406947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e82ed-e0df-4235-a6fe-5ea57197bcf3 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.412021 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019210b-6488-4297-a84b-6f52ede7b77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.412688 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019210b-6488-4297-a84b-6f52ede7b77a admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.412983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019210b-6488-4297-a84b-6f52ede7b77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.413241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019210b-6488-4297-a84b-6f52ede7b77a admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.413917 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019210b-6488-4297-a84b-6f52ede7b77a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.415883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019210b-6488-4297-a84b-6f52ede7b77a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.451087 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1389/2761] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:51:11 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:11.455077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf1b0-69fc-4d37-9ff7-b26e832c8dfc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.466193 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcf1b0-69fc-4d37-9ff7-b26e832c8dfc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.485427 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:11.531973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31147b-4bb5-4b0b-86c1-0668e92a86d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.533075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31147b-4bb5-4b0b-86c1-0668e92a86d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.533898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31147b-4bb5-4b0b-86c1-0668e92a86d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.534435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31147b-4bb5-4b0b-86c1-0668e92a86d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.535426 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31147b-4bb5-4b0b-86c1-0668e92a86d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.537981 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31147b-4bb5-4b0b-86c1-0668e92a86d6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.566245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1373/2762] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:51:11 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:11.566967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019210b-6488-4297-a84b-6f52ede7b77a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.578257 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019210b-6488-4297-a84b-6f52ede7b77a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.583252 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9eba48-cc22-48fa-a368-98a0e29c137b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.584183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9eba48-cc22-48fa-a368-98a0e29c137b admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.584538 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9eba48-cc22-48fa-a368-98a0e29c137b admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.584879 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9eba48-cc22-48fa-a368-98a0e29c137b admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.585586 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9eba48-cc22-48fa-a368-98a0e29c137b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.587176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9eba48-cc22-48fa-a368-98a0e29c137b admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.599482 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1390/2763] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:51:11.603833 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31147b-4bb5-4b0b-86c1-0668e92a86d6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.614163 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31147b-4bb5-4b0b-86c1-0668e92a86d6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.618874 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc18d6-9297-4c1c-82a5-001dabaf5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.619536 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc18d6-9297-4c1c-82a5-001dabaf5e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.619817 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc18d6-9297-4c1c-82a5-001dabaf5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.620093 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc18d6-9297-4c1c-82a5-001dabaf5e89 admin admin] PATH_INFO: `/v3/projects/318a92c738fa43e483bee0bb37b42c48/users/4a7f45f87a8d4bee928f62113f9a5b1d/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.635163 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc18d6-9297-4c1c-82a5-001dabaf5e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318a92c738fa43e483bee0bb37b42c48, user_id=4a7f45f87a8d4bee928f62113f9a5b1d, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.637849 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc18d6-9297-4c1c-82a5-001dabaf5e89 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.653430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1374/2764] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:11 2022] PUT /identity/v3/projects/318a92c738fa43e483bee0bb37b42c48/users/4a7f45f87a8d4bee928f62113f9a5b1d/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:11.657500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9eba48-cc22-48fa-a368-98a0e29c137b admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.667527 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9eba48-cc22-48fa-a368-98a0e29c137b admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.724650 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e0bdd-12fe-42bd-9d2f-d81383a9950d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.725160 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0bdd-12fe-42bd-9d2f-d81383a9950d admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.725619 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0bdd-12fe-42bd-9d2f-d81383a9950d admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.726098 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e0bdd-12fe-42bd-9d2f-d81383a9950d admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.726980 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0bdd-12fe-42bd-9d2f-d81383a9950d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.728614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e0bdd-12fe-42bd-9d2f-d81383a9950d admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.739075 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1391/2765] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:11.743283 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc18d6-9297-4c1c-82a5-001dabaf5e89 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.754140 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc18d6-9297-4c1c-82a5-001dabaf5e89 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.758866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2773-f22d-4f43-b3d3-d88e5b263149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.759517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2773-f22d-4f43-b3d3-d88e5b263149 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.759798 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2773-f22d-4f43-b3d3-d88e5b263149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.760069 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a2773-f22d-4f43-b3d3-d88e5b263149 admin admin] PATH_INFO: `/v3/projects/318a92c738fa43e483bee0bb37b42c48/users/4a7f45f87a8d4bee928f62113f9a5b1d/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.762029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a2773-f22d-4f43-b3d3-d88e5b263149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=318a92c738fa43e483bee0bb37b42c48, user_id=4a7f45f87a8d4bee928f62113f9a5b1d, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.764723 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a2773-f22d-4f43-b3d3-d88e5b263149 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.775266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1375/2766] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:11 2022] PUT /identity/v3/projects/318a92c738fa43e483bee0bb37b42c48/users/4a7f45f87a8d4bee928f62113f9a5b1d/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:11.785356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b3f01-e85f-40aa-a71f-6fa13a3668d7 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.785640 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b3f01-e85f-40aa-a71f-6fa13a3668d7 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.785919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b3f01-e85f-40aa-a71f-6fa13a3668d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.815658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-238b3f01-e85f-40aa-a71f-6fa13a3668d7 None None] MFA Rules not processed for user `4a7f45f87a8d4bee928f62113f9a5b1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:11.816915 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-238b3f01-e85f-40aa-a71f-6fa13a3668d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:11.884249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1392/2767] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:11.896041 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2773-f22d-4f43-b3d3-d88e5b263149 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:11.898161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-821a2773-f22d-4f43-b3d3-d88e5b263149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:11.955627 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a2773-f22d-4f43-b3d3-d88e5b263149 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:11.959493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cea57-8a2d-4899-8cef-5a363afc8ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:11.960112 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cea57-8a2d-4899-8cef-5a363afc8ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:11.960422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cea57-8a2d-4899-8cef-5a363afc8ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:11.960696 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cea57-8a2d-4899-8cef-5a363afc8ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:11.969903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cea57-8a2d-4899-8cef-5a363afc8ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:11.971323 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cea57-8a2d-4899-8cef-5a363afc8ef5 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:11.980883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1376/2768] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:12.063133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b3f01-e85f-40aa-a71f-6fa13a3668d7 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:12.074198 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b3f01-e85f-40aa-a71f-6fa13a3668d7 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:12.077818 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b904-5c06-4877-8f7f-3a05a4bbdb23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:12.078428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b904-5c06-4877-8f7f-3a05a4bbdb23 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:12.078703 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b904-5c06-4877-8f7f-3a05a4bbdb23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:12.078972 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b904-5c06-4877-8f7f-3a05a4bbdb23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:12.103618 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:12.136686 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53b904-5c06-4877-8f7f-3a05a4bbdb23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:12.138158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53b904-5c06-4877-8f7f-3a05a4bbdb23 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:12.146954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1393/2769] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:21.976613 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=60,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:22.142954 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=16 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:27.799265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cea57-8a2d-4899-8cef-5a363afc8ef5 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:27.873803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cea57-8a2d-4899-8cef-5a363afc8ef5 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:27.878898 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:27.879525 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:27.879803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:27.880074 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] PATH_INFO: `/v3/users/63da837f6f20411cbfbcce4d8bff6db7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:27.881252 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] RBAC: Authorizing `identity:delete_user(user_id=63da837f6f20411cbfbcce4d8bff6db7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:27.883139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:27.929387 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63da837f6f20411cbfbcce4d8bff6db7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:27.936064 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63da837f6f20411cbfbcce4d8bff6db7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:27.945959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63da837f6f20411cbfbcce4d8bff6db7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:27.947019 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63da837f6f20411cbfbcce4d8bff6db7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:27.947981 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63da837f6f20411cbfbcce4d8bff6db7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:27.977384 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1377/2770] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:27 2022] DELETE /identity/v3/users/63da837f6f20411cbfbcce4d8bff6db7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:27.981991 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ef2a-be8e-4076-a0fe-8240bb7c2790 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:27.982467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ef2a-be8e-4076-a0fe-8240bb7c2790 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:27.982565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e1ef2a-be8e-4076-a0fe-8240bb7c2790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:28.002468 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-78e1ef2a-be8e-4076-a0fe-8240bb7c2790 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:28.003664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-78e1ef2a-be8e-4076-a0fe-8240bb7c2790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:28.070380 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1394/2771] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:28.081494 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:28.082896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:28.140707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd533a-f5b4-4098-ad90-cc76fc9476db admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:28.145029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21124963-17c4-409b-a6da-ae730c5c5876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:28.145646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21124963-17c4-409b-a6da-ae730c5c5876 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:28.145928 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21124963-17c4-409b-a6da-ae730c5c5876 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:28.146200 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21124963-17c4-409b-a6da-ae730c5c5876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:28.156876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21124963-17c4-409b-a6da-ae730c5c5876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:28.158732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21124963-17c4-409b-a6da-ae730c5c5876 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:28.171125 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1378/2772] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:51:28.469681 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1ef2a-be8e-4076-a0fe-8240bb7c2790 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:28.471284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-78e1ef2a-be8e-4076-a0fe-8240bb7c2790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:28.483981 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e1ef2a-be8e-4076-a0fe-8240bb7c2790 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:28.493559 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:28.494240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:28.494539 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:28.494809 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] PATH_INFO: `/v3/projects/4795bc0adce449c6961dfd6c3c86c9a7` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:28.496101 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4795bc0adce449c6961dfd6c3c86c9a7)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:28.498082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:28.547559 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4795bc0adce449c6961dfd6c3c86c9a7', 'request_id': 'req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.556308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4795bc0adce449c6961dfd6c3c86c9a7', 'request_id': 'req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.563939 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4795bc0adce449c6961dfd6c3c86c9a7', 'request_id': 'req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.575458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] The token cache is being invalidate because project 4795bc0adce449c6961dfd6c3c86c9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:28.575746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.576423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.577992 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1395/2773] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:28 2022] DELETE /identity/v3/projects/4795bc0adce449c6961dfd6c3c86c9a7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:28.581991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21124963-17c4-409b-a6da-ae730c5c5876 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:28.591551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21124963-17c4-409b-a6da-ae730c5c5876 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:28.617713 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:28.660265 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:28.660978 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:28.661186 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:28.661454 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] PATH_INFO: `/v3/users/4a7f45f87a8d4bee928f62113f9a5b1d` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:28.662599 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a7f45f87a8d4bee928f62113f9a5b1d)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:28.664528 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:28.712050 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a7f45f87a8d4bee928f62113f9a5b1d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.719058 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a7f45f87a8d4bee928f62113f9a5b1d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.727514 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a7f45f87a8d4bee928f62113f9a5b1d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.728284 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a7f45f87a8d4bee928f62113f9a5b1d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.728893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-33b9a657-20ac-4835-998b-5fc7e8f568e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a7f45f87a8d4bee928f62113f9a5b1d'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:28.746868 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1379/2774] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:28 2022] DELETE /identity/v3/users/4a7f45f87a8d4bee928f62113f9a5b1d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:29.042490 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:29.044605 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:29.058696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc541951-1e7d-48d9-a4ec-0e8bc4f70e92 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:29.121219 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:29.121877 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.122157 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.122428 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] PATH_INFO: `/v3/projects/318a92c738fa43e483bee0bb37b42c48` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.123675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318a92c738fa43e483bee0bb37b42c48)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:29.125733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:29.156145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:29.176711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318a92c738fa43e483bee0bb37b42c48', 'request_id': 'req-4f211557-8186-4be7-a4fe-8bec221c3744'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:29.182929 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318a92c738fa43e483bee0bb37b42c48', 'request_id': 'req-4f211557-8186-4be7-a4fe-8bec221c3744'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:29.192943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318a92c738fa43e483bee0bb37b42c48', 'request_id': 'req-4f211557-8186-4be7-a4fe-8bec221c3744'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:29.203784 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] The token cache is being invalidate because project 318a92c738fa43e483bee0bb37b42c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:29.204095 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:29.205282 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-4f211557-8186-4be7-a4fe-8bec221c3744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:29.206786 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1396/2775] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:29 2022] DELETE /identity/v3/projects/318a92c738fa43e483bee0bb37b42c48 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:29.211666 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0eaed-c748-45b6-9a4c-df17442fdf09 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.212209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0eaed-c748-45b6-9a4c-df17442fdf09 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.212209 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0eaed-c748-45b6-9a4c-df17442fdf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.234023 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-98c0eaed-c748-45b6-9a4c-df17442fdf09 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:29.235326 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-98c0eaed-c748-45b6-9a4c-df17442fdf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:29.307784 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1380/2776] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:29.320632 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5479-ec98-4f5a-b82f-8c5cde06904d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.321055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5479-ec98-4f5a-b82f-8c5cde06904d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.321457 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c5479-ec98-4f5a-b82f-8c5cde06904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.342410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-7b2c5479-ec98-4f5a-b82f-8c5cde06904d None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:29.343768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7b2c5479-ec98-4f5a-b82f-8c5cde06904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:29.351983 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1397/2777] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:29.357146 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0eaed-c748-45b6-9a4c-df17442fdf09 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:29.366815 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0eaed-c748-45b6-9a4c-df17442fdf09 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:29.371342 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2799b4-46e0-4897-bbf5-7d03b3c4d02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:29.371960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2799b4-46e0-4897-bbf5-7d03b3c4d02c admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.372256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2799b4-46e0-4897-bbf5-7d03b3c4d02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.372529 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2799b4-46e0-4897-bbf5-7d03b3c4d02c admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.373219 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2799b4-46e0-4897-bbf5-7d03b3c4d02c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:51:29.373521 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2799b4-46e0-4897-bbf5-7d03b3c4d02c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:29.375212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2799b4-46e0-4897-bbf5-7d03b3c4d02c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:29.389711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1381/2778] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:51:29.396642 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5479-ec98-4f5a-b82f-8c5cde06904d None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:29.408054 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c5479-ec98-4f5a-b82f-8c5cde06904d None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:29.412828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bcc7d-b108-4f7c-a97b-0e534f8fca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:29.413440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bcc7d-b108-4f7c-a97b-0e534f8fca38 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.413723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bcc7d-b108-4f7c-a97b-0e534f8fca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.413996 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bcc7d-b108-4f7c-a97b-0e534f8fca38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.414713 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bcc7d-b108-4f7c-a97b-0e534f8fca38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:29.416691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bcc7d-b108-4f7c-a97b-0e534f8fca38 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:29.448367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1398/2779] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:51:29 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:51:29.452571 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2799b4-46e0-4897-bbf5-7d03b3c4d02c admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:29.463675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2799b4-46e0-4897-bbf5-7d03b3c4d02c admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:29.490289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:29.526107 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f88f7-ee98-4945-aaa9-b9b283662f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:29.526736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f88f7-ee98-4945-aaa9-b9b283662f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.527012 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f88f7-ee98-4945-aaa9-b9b283662f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.527334 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f88f7-ee98-4945-aaa9-b9b283662f4e admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.528078 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f88f7-ee98-4945-aaa9-b9b283662f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:29.530122 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f88f7-ee98-4945-aaa9-b9b283662f4e admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:29.554227 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1382/2780] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:51:29 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:29.562664 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bcc7d-b108-4f7c-a97b-0e534f8fca38 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:29.574414 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bcc7d-b108-4f7c-a97b-0e534f8fca38 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:29.579105 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9bcf1-68a9-4aa1-a8cc-89411347563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:29.580396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9bcf1-68a9-4aa1-a8cc-89411347563a admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.580677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9bcf1-68a9-4aa1-a8cc-89411347563a admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.580984 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9bcf1-68a9-4aa1-a8cc-89411347563a admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.581680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9bcf1-68a9-4aa1-a8cc-89411347563a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:29.583508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9bcf1-68a9-4aa1-a8cc-89411347563a admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:29.595435 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1399/2781] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:51:29.599731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f88f7-ee98-4945-aaa9-b9b283662f4e admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:29.611853 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f88f7-ee98-4945-aaa9-b9b283662f4e admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:29.616621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb1738-7326-4cf7-8037-8cb2aacd462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:29.617242 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1738-7326-4cf7-8037-8cb2aacd462f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.617522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1738-7326-4cf7-8037-8cb2aacd462f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.617791 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1738-7326-4cf7-8037-8cb2aacd462f admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.618488 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb1738-7326-4cf7-8037-8cb2aacd462f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:29.620083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb1738-7326-4cf7-8037-8cb2aacd462f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:29.632185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1383/2782] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:29.636615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9bcf1-68a9-4aa1-a8cc-89411347563a admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:29.648356 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9bcf1-68a9-4aa1-a8cc-89411347563a admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:29.653216 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c1832-f2b4-4c98-9dcb-3f97ebdbd3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:29.653891 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c1832-f2b4-4c98-9dcb-3f97ebdbd3d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.654172 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c1832-f2b4-4c98-9dcb-3f97ebdbd3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.654445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c1832-f2b4-4c98-9dcb-3f97ebdbd3d4 admin admin] PATH_INFO: `/v3/projects/650a243069e54267bfa5400c8c4d5051/users/aacbfbd0ec46497d9f2f3f5435d35717/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.672013 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c1832-f2b4-4c98-9dcb-3f97ebdbd3d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650a243069e54267bfa5400c8c4d5051, user_id=aacbfbd0ec46497d9f2f3f5435d35717, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:29.675233 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c1832-f2b4-4c98-9dcb-3f97ebdbd3d4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:29.688091 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1400/2783] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:29 2022] PUT /identity/v3/projects/650a243069e54267bfa5400c8c4d5051/users/aacbfbd0ec46497d9f2f3f5435d35717/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:29.694150 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050292e-124b-42f5-ace0-6233c73d4128 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.694434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050292e-124b-42f5-ace0-6233c73d4128 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.694709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050292e-124b-42f5-ace0-6233c73d4128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.713580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d050292e-124b-42f5-ace0-6233c73d4128 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:29.714698 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d050292e-124b-42f5-ace0-6233c73d4128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:29.778316 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1384/2784] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:29.788464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c1832-f2b4-4c98-9dcb-3f97ebdbd3d4 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:29.790438 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ff7c1832-f2b4-4c98-9dcb-3f97ebdbd3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:29.859869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c1832-f2b4-4c98-9dcb-3f97ebdbd3d4 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:29.869425 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f5bc3-fd51-4ca0-8cdb-aa45bfb6d405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:29.870070 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f5bc3-fd51-4ca0-8cdb-aa45bfb6d405 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:29.870355 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f5bc3-fd51-4ca0-8cdb-aa45bfb6d405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:29.870630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f5bc3-fd51-4ca0-8cdb-aa45bfb6d405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:29.881692 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f5bc3-fd51-4ca0-8cdb-aa45bfb6d405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:29.883137 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f5bc3-fd51-4ca0-8cdb-aa45bfb6d405 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:29.894055 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1401/2785] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:30.593131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f662c-f5d7-4c43-9362-b361de170b5f None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:30.593816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f662c-f5d7-4c43-9362-b361de170b5f None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:30.593816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f662c-f5d7-4c43-9362-b361de170b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:30.626646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-380f662c-f5d7-4c43-9362-b361de170b5f None None] MFA Rules not processed for user `aacbfbd0ec46497d9f2f3f5435d35717`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:30.628029 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-380f662c-f5d7-4c43-9362-b361de170b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:30.712948 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1385/2786] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:30.717466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f5bc3-fd51-4ca0-8cdb-aa45bfb6d405 service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:30.737300 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f5bc3-fd51-4ca0-8cdb-aa45bfb6d405 service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:30.743274 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf30724-250a-4067-9244-3399a53799ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:30.743892 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf30724-250a-4067-9244-3399a53799ce admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:30.744239 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf30724-250a-4067-9244-3399a53799ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:30.744447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf30724-250a-4067-9244-3399a53799ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:30.745116 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf30724-250a-4067-9244-3399a53799ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:30.747053 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf30724-250a-4067-9244-3399a53799ce admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:30.781227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1402/2787] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:51:30 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:30.791903 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f662c-f5d7-4c43-9362-b361de170b5f None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:30.804632 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f662c-f5d7-4c43-9362-b361de170b5f None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:30.841392 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:30.868301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32610554-9454-4531-b344-ffc3e4395a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:30.868929 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610554-9454-4531-b344-ffc3e4395a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:30.869213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610554-9454-4531-b344-ffc3e4395a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:30.869491 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32610554-9454-4531-b344-ffc3e4395a1a admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:30.870160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32610554-9454-4531-b344-ffc3e4395a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:30.872077 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32610554-9454-4531-b344-ffc3e4395a1a admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:30.900767 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1386/2788] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:51:30 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:30.905009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf30724-250a-4067-9244-3399a53799ce admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:30.919156 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf30724-250a-4067-9244-3399a53799ce admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:30.923874 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf616c-abb0-4d02-b7da-d5228dea4538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:30.927837 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf616c-abb0-4d02-b7da-d5228dea4538 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:30.928265 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf616c-abb0-4d02-b7da-d5228dea4538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:30.928469 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccf616c-abb0-4d02-b7da-d5228dea4538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:30.929165 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf616c-abb0-4d02-b7da-d5228dea4538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:30.931056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccf616c-abb0-4d02-b7da-d5228dea4538 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:30.943245 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1403/2789] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:30.947840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32610554-9454-4531-b344-ffc3e4395a1a admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:30.958717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32610554-9454-4531-b344-ffc3e4395a1a admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:30.963651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f3daa-b3ad-42c9-8c12-fb463a317324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:30.964408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f3daa-b3ad-42c9-8c12-fb463a317324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:30.964688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f3daa-b3ad-42c9-8c12-fb463a317324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:30.964965 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f3daa-b3ad-42c9-8c12-fb463a317324 admin admin] PATH_INFO: `/v3/projects/6980c9454f1d4d14bf9b5398ef127f76/users/f1c8f50160b742b2a319b308fa103302/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:30.980301 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f3daa-b3ad-42c9-8c12-fb463a317324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6980c9454f1d4d14bf9b5398ef127f76, user_id=f1c8f50160b742b2a319b308fa103302, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:30.983462 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f3daa-b3ad-42c9-8c12-fb463a317324 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:30.999535 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1387/2790] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:30 2022] PUT /identity/v3/projects/6980c9454f1d4d14bf9b5398ef127f76/users/f1c8f50160b742b2a319b308fa103302/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:31.004693 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf616c-abb0-4d02-b7da-d5228dea4538 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:31.018919 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccf616c-abb0-4d02-b7da-d5228dea4538 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:31.049125 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:31.094515 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37d49d-dc60-41e2-9bca-153cde9ffe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:31.095139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d49d-dc60-41e2-9bca-153cde9ffe04 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:31.095474 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d49d-dc60-41e2-9bca-153cde9ffe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:31.095746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37d49d-dc60-41e2-9bca-153cde9ffe04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:31.096484 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37d49d-dc60-41e2-9bca-153cde9ffe04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:31.098084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37d49d-dc60-41e2-9bca-153cde9ffe04 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:31.107733 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1404/2791] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:31.112036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f3daa-b3ad-42c9-8c12-fb463a317324 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:31.122511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f3daa-b3ad-42c9-8c12-fb463a317324 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:31.128045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b2104-303d-46e5-9cc8-a362384991f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:31.128960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b2104-303d-46e5-9cc8-a362384991f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:31.129366 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b2104-303d-46e5-9cc8-a362384991f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:31.129542 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b2104-303d-46e5-9cc8-a362384991f9 admin admin] PATH_INFO: `/v3/projects/6980c9454f1d4d14bf9b5398ef127f76/users/f1c8f50160b742b2a319b308fa103302/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:31.131597 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b2104-303d-46e5-9cc8-a362384991f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6980c9454f1d4d14bf9b5398ef127f76, user_id=f1c8f50160b742b2a319b308fa103302, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:31.134573 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b2104-303d-46e5-9cc8-a362384991f9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:31.146452 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1388/2792] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:31 2022] PUT /identity/v3/projects/6980c9454f1d4d14bf9b5398ef127f76/users/f1c8f50160b742b2a319b308fa103302/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:31.813277 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5814c9d-7d3a-422e-9efc-aff2b0c9401b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:31.813800 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5814c9d-7d3a-422e-9efc-aff2b0c9401b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:31.813920 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5814c9d-7d3a-422e-9efc-aff2b0c9401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:31.843520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f5814c9d-7d3a-422e-9efc-aff2b0c9401b None None] MFA Rules not processed for user `f1c8f50160b742b2a319b308fa103302`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:31.844711 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f5814c9d-7d3a-422e-9efc-aff2b0c9401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:31.921630 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1405/2793] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:31.934173 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b2104-303d-46e5-9cc8-a362384991f9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:31.935877 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-774b2104-303d-46e5-9cc8-a362384991f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:32.004105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b2104-303d-46e5-9cc8-a362384991f9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:32.007805 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794caeec-3aa2-40d6-8eac-a14a6a3b01a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:32.008307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794caeec-3aa2-40d6-8eac-a14a6a3b01a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:32.008598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794caeec-3aa2-40d6-8eac-a14a6a3b01a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:32.008873 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794caeec-3aa2-40d6-8eac-a14a6a3b01a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:32.069164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794caeec-3aa2-40d6-8eac-a14a6a3b01a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:32.070591 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794caeec-3aa2-40d6-8eac-a14a6a3b01a7 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:32.080479 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1389/2794] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:33.466205 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5814c9d-7d3a-422e-9efc-aff2b0c9401b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:33.476479 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5814c9d-7d3a-422e-9efc-aff2b0c9401b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:33.479999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2deb3c-6857-4266-8011-680626e61f83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:33.480677 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2deb3c-6857-4266-8011-680626e61f83 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:33.481056 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2deb3c-6857-4266-8011-680626e61f83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:33.481357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2deb3c-6857-4266-8011-680626e61f83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:33.491962 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2deb3c-6857-4266-8011-680626e61f83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:33.493471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2deb3c-6857-4266-8011-680626e61f83 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:33.503464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1406/2795] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:42.075838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=75,keystone:INSERT=5 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:43.499082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=60 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:47.936215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794caeec-3aa2-40d6-8eac-a14a6a3b01a7 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:48.018688 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794caeec-3aa2-40d6-8eac-a14a6a3b01a7 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:48.025063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:48.025828 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:48.026147 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:48.026469 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] PATH_INFO: `/v3/users/aacbfbd0ec46497d9f2f3f5435d35717` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:48.027753 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=aacbfbd0ec46497d9f2f3f5435d35717)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:48.029790 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:48.077893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aacbfbd0ec46497d9f2f3f5435d35717'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.085991 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aacbfbd0ec46497d9f2f3f5435d35717'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.094000 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aacbfbd0ec46497d9f2f3f5435d35717'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.094863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aacbfbd0ec46497d9f2f3f5435d35717'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.095472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aacbfbd0ec46497d9f2f3f5435d35717'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.115376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1390/2796] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:47 2022] DELETE /identity/v3/users/aacbfbd0ec46497d9f2f3f5435d35717 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:48.303308 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2deb3c-6857-4266-8011-680626e61f83 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:48.314796 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2deb3c-6857-4266-8011-680626e61f83 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:48.377000 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:48.377683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:48.377966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:48.378240 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] PATH_INFO: `/v3/projects/650a243069e54267bfa5400c8c4d5051` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:48.380158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650a243069e54267bfa5400c8c4d5051)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:48.382193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:48.432836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650a243069e54267bfa5400c8c4d5051', 'request_id': 'req-3f6cd426-0f90-4575-92d3-caf9366b75d5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.439767 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650a243069e54267bfa5400c8c4d5051', 'request_id': 'req-3f6cd426-0f90-4575-92d3-caf9366b75d5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.451176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650a243069e54267bfa5400c8c4d5051', 'request_id': 'req-3f6cd426-0f90-4575-92d3-caf9366b75d5'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.463579 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] The token cache is being invalidate because project 650a243069e54267bfa5400c8c4d5051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:48.463866 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.464748 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.466365 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1407/2797] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:48 2022] DELETE /identity/v3/projects/650a243069e54267bfa5400c8c4d5051 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:48.470796 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:48.472245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:48.486585 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407fd75-5165-459b-a2d0-245436d13bed admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:48.546179 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:48.546733 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:48.547016 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:48.547299 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] PATH_INFO: `/v3/users/f1c8f50160b742b2a319b308fa103302` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:48.548508 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1c8f50160b742b2a319b308fa103302)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:48.550433 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:48.572989 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:48.601844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1c8f50160b742b2a319b308fa103302'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.609994 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1c8f50160b742b2a319b308fa103302'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.618499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1c8f50160b742b2a319b308fa103302'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.619296 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1c8f50160b742b2a319b308fa103302'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.619908 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f6ecb97c-6540-425d-93f1-201e9834c5a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1c8f50160b742b2a319b308fa103302'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:48.640944 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1391/2798] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:51:48 2022] DELETE /identity/v3/users/f1c8f50160b742b2a319b308fa103302 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:48.829275 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:48.830899 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:48.844798 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd426-0f90-4575-92d3-caf9366b75d5 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:48.929963 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:48.930658 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:48.930867 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:48.931279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] PATH_INFO: `/v3/projects/6980c9454f1d4d14bf9b5398ef127f76` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:48.932403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6980c9454f1d4d14bf9b5398ef127f76)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:48.934329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:48.975395 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:48.996564 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6980c9454f1d4d14bf9b5398ef127f76', 'request_id': 'req-ddc970d0-9580-4f8a-9285-afee7947d5ba'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:49.005918 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6980c9454f1d4d14bf9b5398ef127f76', 'request_id': 'req-ddc970d0-9580-4f8a-9285-afee7947d5ba'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:49.014225 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6980c9454f1d4d14bf9b5398ef127f76', 'request_id': 'req-ddc970d0-9580-4f8a-9285-afee7947d5ba'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:49.026117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] The token cache is being invalidate because project 6980c9454f1d4d14bf9b5398ef127f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:51:49.026403 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:49.027088 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-ddc970d0-9580-4f8a-9285-afee7947d5ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:51:49.028623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1408/2799] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:51:48 2022] DELETE /identity/v3/projects/6980c9454f1d4d14bf9b5398ef127f76 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:49.033861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb2c4-e3b1-486c-96c2-4c8e3be37c1b None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.034349 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb2c4-e3b1-486c-96c2-4c8e3be37c1b None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.034518 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cb2c4-e3b1-486c-96c2-4c8e3be37c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.058443 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ed7cb2c4-e3b1-486c-96c2-4c8e3be37c1b None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:49.059905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ed7cb2c4-e3b1-486c-96c2-4c8e3be37c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:49.124844 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1392/2800] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:49.134690 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53b0fb-6fae-48b0-9bc3-30a4fd20227f None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.134976 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53b0fb-6fae-48b0-9bc3-30a4fd20227f None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.135251 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53b0fb-6fae-48b0-9bc3-30a4fd20227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.155812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-5f53b0fb-6fae-48b0-9bc3-30a4fd20227f None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:49.157045 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-5f53b0fb-6fae-48b0-9bc3-30a4fd20227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:49.165768 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1409/2801] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:49.170533 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cb2c4-e3b1-486c-96c2-4c8e3be37c1b None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:49.182354 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cb2c4-e3b1-486c-96c2-4c8e3be37c1b None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:49.187014 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c3e5a-ba92-41ed-bd1b-4772fb0917b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:49.187629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c3e5a-ba92-41ed-bd1b-4772fb0917b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.187910 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c3e5a-ba92-41ed-bd1b-4772fb0917b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.188220 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c3e5a-ba92-41ed-bd1b-4772fb0917b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.188951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c3e5a-ba92-41ed-bd1b-4772fb0917b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:51:49.189258 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c3e5a-ba92-41ed-bd1b-4772fb0917b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:49.190858 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c3e5a-ba92-41ed-bd1b-4772fb0917b6 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:49.202833 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1393/2802] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:51:49.207345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53b0fb-6fae-48b0-9bc3-30a4fd20227f None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:49.221999 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53b0fb-6fae-48b0-9bc3-30a4fd20227f None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:49.227329 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4a769-5d31-41d5-9d2e-fca3119a1dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:49.227933 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4a769-5d31-41d5-9d2e-fca3119a1dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.228237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4a769-5d31-41d5-9d2e-fca3119a1dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.228508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4a769-5d31-41d5-9d2e-fca3119a1dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.229168 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4a769-5d31-41d5-9d2e-fca3119a1dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:49.231084 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4a769-5d31-41d5-9d2e-fca3119a1dc9 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:49.266339 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1410/2803] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:51:49 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:51:49.271076 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c3e5a-ba92-41ed-bd1b-4772fb0917b6 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:49.283124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c3e5a-ba92-41ed-bd1b-4772fb0917b6 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:49.341207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a8872-959e-4a5e-8699-7428fec1e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:49.342099 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a8872-959e-4a5e-8699-7428fec1e0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.342846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a8872-959e-4a5e-8699-7428fec1e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.342846 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a8872-959e-4a5e-8699-7428fec1e0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.343228 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a8872-959e-4a5e-8699-7428fec1e0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:49.345178 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a8872-959e-4a5e-8699-7428fec1e0c4 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:49.368288 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1394/2804] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:51:49 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:51:49.372437 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4a769-5d31-41d5-9d2e-fca3119a1dc9 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:49.383159 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4a769-5d31-41d5-9d2e-fca3119a1dc9 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:49.387726 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6d6ee-962c-491f-9106-6efdb3fdd0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:49.388370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d6ee-962c-491f-9106-6efdb3fdd0bf admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.388652 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d6ee-962c-491f-9106-6efdb3fdd0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.388922 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6d6ee-962c-491f-9106-6efdb3fdd0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.389615 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6d6ee-962c-491f-9106-6efdb3fdd0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:49.391206 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6d6ee-962c-491f-9106-6efdb3fdd0bf admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:49.401995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1411/2805] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:49.406002 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a8872-959e-4a5e-8699-7428fec1e0c4 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:49.417130 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a8872-959e-4a5e-8699-7428fec1e0c4 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:49.421803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462a8ec-1773-4def-a8c2-d8c658d7e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:49.422404 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462a8ec-1773-4def-a8c2-d8c658d7e2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.422682 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462a8ec-1773-4def-a8c2-d8c658d7e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.422969 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462a8ec-1773-4def-a8c2-d8c658d7e2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.423634 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462a8ec-1773-4def-a8c2-d8c658d7e2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:49.425236 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462a8ec-1773-4def-a8c2-d8c658d7e2ee admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:49.435840 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1395/2806] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:51:49.439977 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6d6ee-962c-491f-9106-6efdb3fdd0bf admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:49.450035 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6d6ee-962c-491f-9106-6efdb3fdd0bf admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:49.454661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967b61f-74c0-47c1-a1ba-e48dca998b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:49.455315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967b61f-74c0-47c1-a1ba-e48dca998b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.455594 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967b61f-74c0-47c1-a1ba-e48dca998b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.455868 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967b61f-74c0-47c1-a1ba-e48dca998b52 admin admin] PATH_INFO: `/v3/projects/3c6e4e1e12db464ba903886b1da734c1/users/1e71494efbc64a76bc7d69f9d3bb7b89/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.470908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967b61f-74c0-47c1-a1ba-e48dca998b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c6e4e1e12db464ba903886b1da734c1, user_id=1e71494efbc64a76bc7d69f9d3bb7b89, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:49.474163 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967b61f-74c0-47c1-a1ba-e48dca998b52 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:49.486931 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1412/2807] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:51:49 2022] PUT /identity/v3/projects/3c6e4e1e12db464ba903886b1da734c1/users/1e71494efbc64a76bc7d69f9d3bb7b89/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:51:49.492118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe780a02-b4f2-46a3-b5c8-ddccd31a72e7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.492436 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe780a02-b4f2-46a3-b5c8-ddccd31a72e7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.492717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe780a02-b4f2-46a3-b5c8-ddccd31a72e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.500932 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:49.513866 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fe780a02-b4f2-46a3-b5c8-ddccd31a72e7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:49.515124 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fe780a02-b4f2-46a3-b5c8-ddccd31a72e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:49.579517 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1396/2808] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:49.590150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967b61f-74c0-47c1-a1ba-e48dca998b52 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:49.591924 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d967b61f-74c0-47c1-a1ba-e48dca998b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:49.657830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967b61f-74c0-47c1-a1ba-e48dca998b52 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:49.661941 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553b6ab-7867-47bf-bf56-118be4d76bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:49.662571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553b6ab-7867-47bf-bf56-118be4d76bfe service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:49.662852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553b6ab-7867-47bf-bf56-118be4d76bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:49.663126 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553b6ab-7867-47bf-bf56-118be4d76bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:49.672492 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553b6ab-7867-47bf-bf56-118be4d76bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:49.673947 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8553b6ab-7867-47bf-bf56-118be4d76bfe service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:49.685655 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1413/2809] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:50.360788 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24c27-53ca-42d3-8e88-11979fef52a6 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:50.361304 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24c27-53ca-42d3-8e88-11979fef52a6 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:50.361406 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f24c27-53ca-42d3-8e88-11979fef52a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:50.393270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-d9f24c27-53ca-42d3-8e88-11979fef52a6 None None] MFA Rules not processed for user `1e71494efbc64a76bc7d69f9d3bb7b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:50.397388 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d9f24c27-53ca-42d3-8e88-11979fef52a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:50.479116 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1397/2810] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:50.491467 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553b6ab-7867-47bf-bf56-118be4d76bfe service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:50.493303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8553b6ab-7867-47bf-bf56-118be4d76bfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:50.564367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553b6ab-7867-47bf-bf56-118be4d76bfe service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:50.568009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67c7a3-0518-4f81-a5a2-6164b3a62567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:50.568763 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67c7a3-0518-4f81-a5a2-6164b3a62567 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:50.569046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67c7a3-0518-4f81-a5a2-6164b3a62567 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:50.569324 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67c7a3-0518-4f81-a5a2-6164b3a62567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:50.580079 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67c7a3-0518-4f81-a5a2-6164b3a62567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:50.581590 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67c7a3-0518-4f81-a5a2-6164b3a62567 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:50.596791 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1414/2811] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:53.051158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a167-f32d-4ad7-ba2e-eb05062030f2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:53.051758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a167-f32d-4ad7-ba2e-eb05062030f2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:53.051758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7a167-f32d-4ad7-ba2e-eb05062030f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:53.072065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-77f7a167-f32d-4ad7-ba2e-eb05062030f2 None None] MFA Rules not processed for user `1e71494efbc64a76bc7d69f9d3bb7b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:53.073308 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-77f7a167-f32d-4ad7-ba2e-eb05062030f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:53.080273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1398/2812] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:51:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:53.762916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67c7a3-0518-4f81-a5a2-6164b3a62567 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:53.762916 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0c67c7a3-0518-4f81-a5a2-6164b3a62567 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:53.766811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:53.854820 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67c7a3-0518-4f81-a5a2-6164b3a62567 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:53.860927 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:53.861751 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:53.862043 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:53.862322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:53.865520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:53.879123 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:53.880869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:53.891826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1415/2813] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:56.717924 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7a167-f32d-4ad7-ba2e-eb05062030f2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:56.720413 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-77f7a167-f32d-4ad7-ba2e-eb05062030f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:56.808083 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7a167-f32d-4ad7-ba2e-eb05062030f2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:56.813711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:56.814340 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:56.814621 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:56.814897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:56.816731 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:56.829992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:56.831630 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:56.843216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1399/2814] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:52:03.755708 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:03.757452 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:03.776347 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28561bd6-2982-422f-8754-18b958ca63d2 service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:03.782161 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6466fa-f87c-46b3-acae-820e42435816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:03.782908 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6466fa-f87c-46b3-acae-820e42435816 service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:03.783309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6466fa-f87c-46b3-acae-820e42435816 service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:03.783670 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6466fa-f87c-46b3-acae-820e42435816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:03.786407 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ad6466fa-f87c-46b3-acae-820e42435816 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:03.805242 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6466fa-f87c-46b3-acae-820e42435816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:03.807473 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6466fa-f87c-46b3-acae-820e42435816 service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:03.819417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1416/2815] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:52:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:52:06.838659 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=94 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:06.850289 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:06.851738 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:06.866867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838a9e8-90a3-4f89-8d13-bc526a6b3804 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:06.873330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:06.874009 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:06.874271 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:06.874548 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] PATH_INFO: `/v3/users/9eb144b706484316b177bfc9690444d7` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:06.875734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb144b706484316b177bfc9690444d7)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:06.877730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:06.937626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb144b706484316b177bfc9690444d7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:06.948896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb144b706484316b177bfc9690444d7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:06.957774 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb144b706484316b177bfc9690444d7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:06.958615 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb144b706484316b177bfc9690444d7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:06.959256 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb144b706484316b177bfc9690444d7'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:06.978129 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1400/2816] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:52:06 2022] DELETE /identity/v3/users/9eb144b706484316b177bfc9690444d7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:52:06.984410 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c4ca5-4efd-4c3a-ad5a-8f1394230755 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:06.985171 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c4ca5-4efd-4c3a-ad5a-8f1394230755 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:06.985465 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c4ca5-4efd-4c3a-ad5a-8f1394230755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:07.008183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f64c4ca5-4efd-4c3a-ad5a-8f1394230755 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:52:07.009384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f64c4ca5-4efd-4c3a-ad5a-8f1394230755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:07.084563 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1417/2817] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:52:07.097779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:07.099451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:07.172712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407af89e-2e0f-4187-9a02-d28dcf684776 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:07.176432 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c54e719-72ca-4b20-b75f-2239ecf5b064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:07.177047 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54e719-72ca-4b20-b75f-2239ecf5b064 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:07.177344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54e719-72ca-4b20-b75f-2239ecf5b064 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:07.177594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c54e719-72ca-4b20-b75f-2239ecf5b064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:07.187358 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54e719-72ca-4b20-b75f-2239ecf5b064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:07.188859 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c54e719-72ca-4b20-b75f-2239ecf5b064 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:07.199546 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1401/2818] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:52:07.552280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c4ca5-4efd-4c3a-ad5a-8f1394230755 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:07.553745 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f64c4ca5-4efd-4c3a-ad5a-8f1394230755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:07.567802 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c4ca5-4efd-4c3a-ad5a-8f1394230755 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:07.573052 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:07.573702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:07.573978 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:07.574254 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] PATH_INFO: `/v3/projects/fc7422bd6cc34b35938c6581b97a54f2` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:07.575434 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc7422bd6cc34b35938c6581b97a54f2)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:07.578074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:07.630614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc7422bd6cc34b35938c6581b97a54f2', 'request_id': 'req-bec719d4-18e9-4cbc-af76-ab25f05d84fd'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:07.637508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc7422bd6cc34b35938c6581b97a54f2', 'request_id': 'req-bec719d4-18e9-4cbc-af76-ab25f05d84fd'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:07.645889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc7422bd6cc34b35938c6581b97a54f2', 'request_id': 'req-bec719d4-18e9-4cbc-af76-ab25f05d84fd'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:07.660398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] The token cache is being invalidate because project fc7422bd6cc34b35938c6581b97a54f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:52:07.660861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:07.661603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:07.663404 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1418/2819] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:52:07 2022] DELETE /identity/v3/projects/fc7422bd6cc34b35938c6581b97a54f2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:52:11.165055 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a14b2-c034-4c13-b599-594435bc8d90 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:11.165650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a14b2-c034-4c13-b599-594435bc8d90 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:11.165650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a14b2-c034-4c13-b599-594435bc8d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:11.185376 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4f2a14b2-c034-4c13-b599-594435bc8d90 None None] MFA Rules not processed for user `1e71494efbc64a76bc7d69f9d3bb7b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:52:11.186588 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4f2a14b2-c034-4c13-b599-594435bc8d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:11.243493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1402/2820] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:52:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:52:11.489217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:11.490811 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:11.497112 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:11.552845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec719d4-18e9-4cbc-af76-ab25f05d84fd admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:11.556901 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:11.557511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:11.557790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:11.558060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:11.559827 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:11.569421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:11.570861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:11.580192 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1419/2821] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:52:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:52:21.236434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:21.576194 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=25 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:34.301984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc9bc-541e-4a1e-8ee8-ca2b73c408fc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:34.302466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc9bc-541e-4a1e-8ee8-ca2b73c408fc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:34.302562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fc9bc-541e-4a1e-8ee8-ca2b73c408fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:34.355496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-ee1fc9bc-541e-4a1e-8ee8-ca2b73c408fc None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:52:34.356231 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ee1fc9bc-541e-4a1e-8ee8-ca2b73c408fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:34.425040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1403/2822] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:52:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:52:34.472890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:34.474641 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:34.569555 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2011e1-3fa7-4472-a916-4aea2c7fcbba service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:34.575616 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a80ef5-ad82-4466-a9e4-5e920e50628c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:34.576283 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a80ef5-ad82-4466-a9e4-5e920e50628c service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:34.576561 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a80ef5-ad82-4466-a9e4-5e920e50628c service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:34.576828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a80ef5-ad82-4466-a9e4-5e920e50628c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:34.585501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a80ef5-ad82-4466-a9e4-5e920e50628c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:34.587082 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a80ef5-ad82-4466-a9e4-5e920e50628c service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:34.595401 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1420/2823] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:52:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:52:44.422162 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=40 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:44.592062 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=41 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:49.260712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3b4c2-beaf-4eef-b8e9-c62980c187d5 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:49.261215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3b4c2-beaf-4eef-b8e9-c62980c187d5 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:49.261319 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3b4c2-beaf-4eef-b8e9-c62980c187d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:49.282579 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3bc3b4c2-beaf-4eef-b8e9-c62980c187d5 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:52:49.283781 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3bc3b4c2-beaf-4eef-b8e9-c62980c187d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:49.291165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1404/2824] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 2 21:52:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:52:49.304256 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a80ef5-ad82-4466-a9e4-5e920e50628c service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:49.314886 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a80ef5-ad82-4466-a9e4-5e920e50628c service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:49.320005 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d8cb9-dc03-4a31-ae1c-bfdddb1c1c81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:49.320639 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d8cb9-dc03-4a31-ae1c-bfdddb1c1c81 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:49.320921 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d8cb9-dc03-4a31-ae1c-bfdddb1c1c81 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:49.321224 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d8cb9-dc03-4a31-ae1c-bfdddb1c1c81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:49.329723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d8cb9-dc03-4a31-ae1c-bfdddb1c1c81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:49.331295 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d8cb9-dc03-4a31-ae1c-bfdddb1c1c81 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:49.340058 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1421/2825] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:52:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:52:51.755675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3b4c2-beaf-4eef-b8e9-c62980c187d5 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:51.757540 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3bc3b4c2-beaf-4eef-b8e9-c62980c187d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:51.834624 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3b4c2-beaf-4eef-b8e9-c62980c187d5 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:51.840205 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:51.840881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:51.841160 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:51.841431 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] PATH_INFO: `/v3/users/1e71494efbc64a76bc7d69f9d3bb7b89` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:51.842631 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e71494efbc64a76bc7d69f9d3bb7b89)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:51.844592 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:51.895400 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e71494efbc64a76bc7d69f9d3bb7b89'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:51.904998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e71494efbc64a76bc7d69f9d3bb7b89'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:51.914006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e71494efbc64a76bc7d69f9d3bb7b89'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:51.915239 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e71494efbc64a76bc7d69f9d3bb7b89'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:51.915620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-f102211e-855b-4bd6-9624-829f48c8d48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e71494efbc64a76bc7d69f9d3bb7b89'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:51.939768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1405/2826] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:52:51 2022] DELETE /identity/v3/users/1e71494efbc64a76bc7d69f9d3bb7b89 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:52:52.291409 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d8cb9-dc03-4a31-ae1c-bfdddb1c1c81 service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:52.317698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d8cb9-dc03-4a31-ae1c-bfdddb1c1c81 service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:52.376730 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:52.378143 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.378431 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.378715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] PATH_INFO: `/v3/projects/3c6e4e1e12db464ba903886b1da734c1` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.380089 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c6e4e1e12db464ba903886b1da734c1)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:52.382040 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:52.432118 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c6e4e1e12db464ba903886b1da734c1', 'request_id': 'req-aac06433-bdb9-4eb2-851d-50d5a4cf0892'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:52.438795 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c6e4e1e12db464ba903886b1da734c1', 'request_id': 'req-aac06433-bdb9-4eb2-851d-50d5a4cf0892'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:52.449861 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c6e4e1e12db464ba903886b1da734c1', 'request_id': 'req-aac06433-bdb9-4eb2-851d-50d5a4cf0892'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:52.467078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] The token cache is being invalidate because project 3c6e4e1e12db464ba903886b1da734c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:52:52.467569 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:52.468653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-aac06433-bdb9-4eb2-851d-50d5a4cf0892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:52.475732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1422/2827] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:52:52 2022] DELETE /identity/v3/projects/3c6e4e1e12db464ba903886b1da734c1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:52:52.475998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43343b04-23ed-478f-aad7-1cbe741663e3 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.476378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43343b04-23ed-478f-aad7-1cbe741663e3 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.476756 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43343b04-23ed-478f-aad7-1cbe741663e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.498648 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-43343b04-23ed-478f-aad7-1cbe741663e3 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:52:52.499976 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-43343b04-23ed-478f-aad7-1cbe741663e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:52.569065 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1406/2828] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:52:52.577440 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399a413-30be-458a-abe4-704ee81accab None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.577828 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399a413-30be-458a-abe4-704ee81accab None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.578213 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399a413-30be-458a-abe4-704ee81accab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.598424 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-e399a413-30be-458a-abe4-704ee81accab None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:52:52.599808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e399a413-30be-458a-abe4-704ee81accab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:52.608944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1423/2829] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:52:52.613324 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43343b04-23ed-478f-aad7-1cbe741663e3 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:52.623481 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43343b04-23ed-478f-aad7-1cbe741663e3 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:52.628240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f07ad-ca31-4f8c-b295-713cfeee8244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:52.628855 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f07ad-ca31-4f8c-b295-713cfeee8244 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.629139 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f07ad-ca31-4f8c-b295-713cfeee8244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.629487 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0f07ad-ca31-4f8c-b295-713cfeee8244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.630187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f07ad-ca31-4f8c-b295-713cfeee8244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:52:52.630503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f07ad-ca31-4f8c-b295-713cfeee8244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:52.632119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0f07ad-ca31-4f8c-b295-713cfeee8244 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:52.645614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:52.649999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1407/2830] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:52:52.655289 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399a413-30be-458a-abe4-704ee81accab None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:52.666719 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399a413-30be-458a-abe4-704ee81accab None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:52.672623 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72644e-92d8-48d0-b7e0-9552bd4521ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:52.673243 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72644e-92d8-48d0-b7e0-9552bd4521ae admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.673520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72644e-92d8-48d0-b7e0-9552bd4521ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.673790 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72644e-92d8-48d0-b7e0-9552bd4521ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.674519 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72644e-92d8-48d0-b7e0-9552bd4521ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:52.676396 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72644e-92d8-48d0-b7e0-9552bd4521ae admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:52.705009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1424/2831] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:52:52 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:52:52.709234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f07ad-ca31-4f8c-b295-713cfeee8244 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:52.720059 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0f07ad-ca31-4f8c-b295-713cfeee8244 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:52.781806 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13693e3e-9326-4603-8588-170563e333fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:52.782503 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693e3e-9326-4603-8588-170563e333fe admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.782707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693e3e-9326-4603-8588-170563e333fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.782984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693e3e-9326-4603-8588-170563e333fe admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.783690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13693e3e-9326-4603-8588-170563e333fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:52.785737 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13693e3e-9326-4603-8588-170563e333fe admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:52.810325 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1408/2832] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:52:52 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:52:52.814150 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72644e-92d8-48d0-b7e0-9552bd4521ae admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:52.825504 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72644e-92d8-48d0-b7e0-9552bd4521ae admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:52.830377 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbceaae-6430-48da-9d60-385fbca4cf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:52.831007 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbceaae-6430-48da-9d60-385fbca4cf58 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.831293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbceaae-6430-48da-9d60-385fbca4cf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.831574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbceaae-6430-48da-9d60-385fbca4cf58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.832368 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbceaae-6430-48da-9d60-385fbca4cf58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:52.834030 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbceaae-6430-48da-9d60-385fbca4cf58 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:52.846298 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1425/2833] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:52:52.850428 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13693e3e-9326-4603-8588-170563e333fe admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:52.862007 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13693e3e-9326-4603-8588-170563e333fe admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:52.866838 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19616584-4ff1-4b79-8b98-54fcf5f33795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:52.867476 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19616584-4ff1-4b79-8b98-54fcf5f33795 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.867758 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19616584-4ff1-4b79-8b98-54fcf5f33795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.868033 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19616584-4ff1-4b79-8b98-54fcf5f33795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.868770 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19616584-4ff1-4b79-8b98-54fcf5f33795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:52.870395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19616584-4ff1-4b79-8b98-54fcf5f33795 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:52.882207 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1409/2834] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:52:52.886960 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbceaae-6430-48da-9d60-385fbca4cf58 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:52.898189 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbceaae-6430-48da-9d60-385fbca4cf58 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:52.903815 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ea237-74aa-4a88-9964-dfa74b2b4d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:52.904543 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ea237-74aa-4a88-9964-dfa74b2b4d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.904822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ea237-74aa-4a88-9964-dfa74b2b4d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.905093 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39ea237-74aa-4a88-9964-dfa74b2b4d09 admin admin] PATH_INFO: `/v3/projects/8c5722bb5e6649349d592852f0b80219/users/d1cdf68073bc425d8a552ec690aebb1c/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.920732 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ea237-74aa-4a88-9964-dfa74b2b4d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c5722bb5e6649349d592852f0b80219, user_id=d1cdf68073bc425d8a552ec690aebb1c, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:52.923398 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39ea237-74aa-4a88-9964-dfa74b2b4d09 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:52.938279 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1426/2835] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:52:52 2022] PUT /identity/v3/projects/8c5722bb5e6649349d592852f0b80219/users/d1cdf68073bc425d8a552ec690aebb1c/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:52:52.949909 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38c91-94eb-4dbc-b45d-66e5068b524e None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:52.950191 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38c91-94eb-4dbc-b45d-66e5068b524e None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:52.950466 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf38c91-94eb-4dbc-b45d-66e5068b524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:52.981267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-3cf38c91-94eb-4dbc-b45d-66e5068b524e None None] MFA Rules not processed for user `d1cdf68073bc425d8a552ec690aebb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:52:52.982496 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3cf38c91-94eb-4dbc-b45d-66e5068b524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:53.053836 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1410/2836] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:52:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:52:53.065788 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ea237-74aa-4a88-9964-dfa74b2b4d09 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:53.067522 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-e39ea237-74aa-4a88-9964-dfa74b2b4d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:53.083269 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:53.130316 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39ea237-74aa-4a88-9964-dfa74b2b4d09 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:53.134363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecf2e5-eef8-4133-85d3-d2755f2beae2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:53.134587 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecf2e5-eef8-4133-85d3-d2755f2beae2 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:53.135536 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecf2e5-eef8-4133-85d3-d2755f2beae2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:53.135696 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecf2e5-eef8-4133-85d3-d2755f2beae2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:53.145293 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecf2e5-eef8-4133-85d3-d2755f2beae2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:53.146746 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecf2e5-eef8-4133-85d3-d2755f2beae2 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:53.155914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1427/2837] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:52:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:52:54.549174 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a4ca1-624c-4e2f-a884-4c98eddad5bc None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:54.549746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a4ca1-624c-4e2f-a884-4c98eddad5bc None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:54.549746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a4ca1-624c-4e2f-a884-4c98eddad5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:54.569282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-089a4ca1-624c-4e2f-a884-4c98eddad5bc None None] MFA Rules not processed for user `d1cdf68073bc425d8a552ec690aebb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:52:54.570511 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-089a4ca1-624c-4e2f-a884-4c98eddad5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:54.577920 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1411/2838] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:52:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:52:58.945529 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecf2e5-eef8-4133-85d3-d2755f2beae2 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:58.947520 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-afecf2e5-eef8-4133-85d3-d2755f2beae2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:59.033183 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecf2e5-eef8-4133-85d3-d2755f2beae2 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:59.039103 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ee1ad-2d39-4867-b2ed-6d3c072148dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:59.039873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ee1ad-2d39-4867-b2ed-6d3c072148dc service nova] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:59.040309 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ee1ad-2d39-4867-b2ed-6d3c072148dc service nova] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:59.040682 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ee1ad-2d39-4867-b2ed-6d3c072148dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:59.042624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-bb4ee1ad-2d39-4867-b2ed-6d3c072148dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:59.056940 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ee1ad-2d39-4867-b2ed-6d3c072148dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:59.058702 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ee1ad-2d39-4867-b2ed-6d3c072148dc service nova] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:59.071542 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1428/2839] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:52:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:53:04.565057 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:04.657988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a4ca1-624c-4e2f-a884-4c98eddad5bc None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:04.659559 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-089a4ca1-624c-4e2f-a884-4c98eddad5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:04.749678 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a4ca1-624c-4e2f-a884-4c98eddad5bc None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:04.756998 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:04.758118 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:04.758717 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:04.759214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:04.761472 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:04.859495 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:04.861169 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:04.872782 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1412/2840] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:53:09.067987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=54 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:11.515660 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320dc16-d4a7-4338-910a-b2739bf2421d None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:11.516348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320dc16-d4a7-4338-910a-b2739bf2421d None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:11.516348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320dc16-d4a7-4338-910a-b2739bf2421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:11.538152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-9320dc16-d4a7-4338-910a-b2739bf2421d None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:11.539386 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-9320dc16-d4a7-4338-910a-b2739bf2421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:11.631694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1429/2841] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:53:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:53:11.645192 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:11.647010 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:11.743397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e89f9c-13a9-41d9-b40e-40053ce88feb service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:11.751516 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abbb89-f0fb-408e-b10c-983e7fc1643a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:11.752604 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abbb89-f0fb-408e-b10c-983e7fc1643a service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:11.753096 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abbb89-f0fb-408e-b10c-983e7fc1643a service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:11.753504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abbb89-f0fb-408e-b10c-983e7fc1643a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:11.763132 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abbb89-f0fb-408e-b10c-983e7fc1643a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:11.764803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abbb89-f0fb-408e-b10c-983e7fc1643a service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:11.777614 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1413/2842] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:53:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:53:12.576280 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7645-a7ba-4fef-a33e-4e850a9b7d84 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:12.576842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7645-a7ba-4fef-a33e-4e850a9b7d84 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:12.576842 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7645-a7ba-4fef-a33e-4e850a9b7d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:12.608843 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-f14d7645-a7ba-4fef-a33e-4e850a9b7d84 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:12.609433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f14d7645-a7ba-4fef-a33e-4e850a9b7d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:12.618342 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1430/2843] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 2 21:53:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:53:12.635045 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abbb89-f0fb-408e-b10c-983e7fc1643a service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:12.653164 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abbb89-f0fb-408e-b10c-983e7fc1643a service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:12.662816 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799739a0-6576-45ac-924e-fec9f9da5b77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:12.663607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799739a0-6576-45ac-924e-fec9f9da5b77 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:12.663890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799739a0-6576-45ac-924e-fec9f9da5b77 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:12.664170 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799739a0-6576-45ac-924e-fec9f9da5b77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:12.675687 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799739a0-6576-45ac-924e-fec9f9da5b77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:12.677344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799739a0-6576-45ac-924e-fec9f9da5b77 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:12.693949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1414/2844] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:53:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:53:12.872628 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7645-a7ba-4fef-a33e-4e850a9b7d84 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:12.874397 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f14d7645-a7ba-4fef-a33e-4e850a9b7d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:12.939270 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799739a0-6576-45ac-924e-fec9f9da5b77 service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:12.941675 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-799739a0-6576-45ac-924e-fec9f9da5b77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:12.971166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799739a0-6576-45ac-924e-fec9f9da5b77 service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:12.989442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:12.989442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:12.989829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:12.989829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] PATH_INFO: `/v3/users/5377fd0bccf748dda1d0192080253dcf` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:13.004460 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7645-a7ba-4fef-a33e-4e850a9b7d84 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:13.009549 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5377fd0bccf748dda1d0192080253dcf)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:13.013367 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecaad1-5b77-4ce0-87fb-55995b668ad7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:13.013619 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:13.021237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecaad1-5b77-4ce0-87fb-55995b668ad7 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:13.021237 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecaad1-5b77-4ce0-87fb-55995b668ad7 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:13.021614 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecaad1-5b77-4ce0-87fb-55995b668ad7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:13.024766 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d7ecaad1-5b77-4ce0-87fb-55995b668ad7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:13.030575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:13.054145 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecaad1-5b77-4ce0-87fb-55995b668ad7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:13.057687 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecaad1-5b77-4ce0-87fb-55995b668ad7 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:13.074636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1431/2845] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:53:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:53:13.076952 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689792-3e13-4630-9f14-b3e045899078 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:13.077315 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689792-3e13-4630-9f14-b3e045899078 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:13.077669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3689792-3e13-4630-9f14-b3e045899078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:13.094606 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5377fd0bccf748dda1d0192080253dcf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.103836 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-b3689792-3e13-4630-9f14-b3e045899078 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:13.105450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b3689792-3e13-4630-9f14-b3e045899078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:13.110212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5377fd0bccf748dda1d0192080253dcf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.113284 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1432/2846] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:53:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:53:13.124153 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5377fd0bccf748dda1d0192080253dcf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.124937 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5377fd0bccf748dda1d0192080253dcf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.125464 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5377fd0bccf748dda1d0192080253dcf'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.128041 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689792-3e13-4630-9f14-b3e045899078 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:13.145249 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3689792-3e13-4630-9f14-b3e045899078 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:13.151895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1389fb-ac43-4913-8cdb-38f8b4c83821 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:13.152556 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1389fb-ac43-4913-8cdb-38f8b4c83821 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:13.152829 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1415/2847] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:53:12 2022] DELETE /identity/v3/users/5377fd0bccf748dda1d0192080253dcf => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:53:13.152944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1389fb-ac43-4913-8cdb-38f8b4c83821 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:13.153096 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1389fb-ac43-4913-8cdb-38f8b4c83821 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:13.154967 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2a1389fb-ac43-4913-8cdb-38f8b4c83821 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:13.167057 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1389fb-ac43-4913-8cdb-38f8b4c83821 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:13.168772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1389fb-ac43-4913-8cdb-38f8b4c83821 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:13.177888 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1433/2848] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:53:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 21:53:13.373102 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:13.375950 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:13.456810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8ba54-f3eb-47a2-a51c-06f6b7526b56 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:13.461670 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:13.462315 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:13.462594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:13.462864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] PATH_INFO: `/v3/projects/0bed6dd5430c4c9983aff2e2f261f5a4` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:13.477306 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bed6dd5430c4c9983aff2e2f261f5a4)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:13.479448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:13.541378 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bed6dd5430c4c9983aff2e2f261f5a4', 'request_id': 'req-7b499fc2-d22d-4c09-9fc8-57242f5b9720'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.552422 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bed6dd5430c4c9983aff2e2f261f5a4', 'request_id': 'req-7b499fc2-d22d-4c09-9fc8-57242f5b9720'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.563105 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bed6dd5430c4c9983aff2e2f261f5a4', 'request_id': 'req-7b499fc2-d22d-4c09-9fc8-57242f5b9720'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.577278 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f2206-fe55-47b0-8106-756f0d43ad25 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:13.577805 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f2206-fe55-47b0-8106-756f0d43ad25 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:13.577904 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f2206-fe55-47b0-8106-756f0d43ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:13.582730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] The token cache is being invalidate because project 0bed6dd5430c4c9983aff2e2f261f5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:53:13.583190 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.584100 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.586062 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1416/2849] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:53:13 2022] DELETE /identity/v3/projects/0bed6dd5430c4c9983aff2e2f261f5a4 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:53:13.591251 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:13.593609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:13.609247 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-c90f2206-fe55-47b0-8106-756f0d43ad25 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:13.610604 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c90f2206-fe55-47b0-8106-756f0d43ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:13.611204 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:13.689165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b499fc2-d22d-4c09-9fc8-57242f5b9720 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:13.690223 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1434/2850] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 2 21:53:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:53:13.697801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:13.699425 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:13.699735 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:13.700185 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] PATH_INFO: `/v3/users/1144bdcfba6e414d9a50e262ae0607d5` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:13.702411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f2206-fe55-47b0-8106-756f0d43ad25 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:13.703845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-c90f2206-fe55-47b0-8106-756f0d43ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:13.719215 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1144bdcfba6e414d9a50e262ae0607d5)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:13.720110 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=100 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:13.721351 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:13.773430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1144bdcfba6e414d9a50e262ae0607d5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.783028 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1144bdcfba6e414d9a50e262ae0607d5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.784503 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f2206-fe55-47b0-8106-756f0d43ad25 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:13.792835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882fcb-1487-43b5-a2e5-4fb907201fa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:13.793574 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882fcb-1487-43b5-a2e5-4fb907201fa6 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:13.793862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882fcb-1487-43b5-a2e5-4fb907201fa6 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:13.794142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61882fcb-1487-43b5-a2e5-4fb907201fa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:13.799618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1144bdcfba6e414d9a50e262ae0607d5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.799618 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1144bdcfba6e414d9a50e262ae0607d5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.799933 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1144bdcfba6e414d9a50e262ae0607d5'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:13.805662 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61882fcb-1487-43b5-a2e5-4fb907201fa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:13.808846 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61882fcb-1487-43b5-a2e5-4fb907201fa6 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:13.820984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1417/2851] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:53:13 2022] DELETE /identity/v3/users/1144bdcfba6e414d9a50e262ae0607d5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:53:13.825345 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1435/2852] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:53:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 21:53:14.052641 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:14.054266 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:14.167894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe308ea-3068-4838-84f4-8ceba0cb2f16 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:14.172982 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:14.173640 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:14.173953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:14.174267 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] PATH_INFO: `/v3/projects/5049adc875fc45b389101348b86ab614` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:14.190803 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5049adc875fc45b389101348b86ab614)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:14.192834 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:14.207153 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:14.256635 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5049adc875fc45b389101348b86ab614', 'request_id': 'req-79af3b3e-6c02-47cc-8555-3edfc1ac3063'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:14.266583 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5049adc875fc45b389101348b86ab614', 'request_id': 'req-79af3b3e-6c02-47cc-8555-3edfc1ac3063'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:14.276754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5049adc875fc45b389101348b86ab614', 'request_id': 'req-79af3b3e-6c02-47cc-8555-3edfc1ac3063'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:14.289622 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] The token cache is being invalidate because project 5049adc875fc45b389101348b86ab614 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:53:14.289941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:14.290558 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-79af3b3e-6c02-47cc-8555-3edfc1ac3063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:14.292092 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1418/2853] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:53:14 2022] DELETE /identity/v3/projects/5049adc875fc45b389101348b86ab614 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:53:16.312956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882fcb-1487-43b5-a2e5-4fb907201fa6 service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:16.314624 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-61882fcb-1487-43b5-a2e5-4fb907201fa6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:16.329912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61882fcb-1487-43b5-a2e5-4fb907201fa6 service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:16.408680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:16.409384 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:16.409665 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:16.409970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] PATH_INFO: `/v3/users/d1cdf68073bc425d8a552ec690aebb1c` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:16.413149 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cdf68073bc425d8a552ec690aebb1c)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:16.417142 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:16.505228 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cdf68073bc425d8a552ec690aebb1c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:16.522208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cdf68073bc425d8a552ec690aebb1c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:16.532840 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cdf68073bc425d8a552ec690aebb1c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:16.533994 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cdf68073bc425d8a552ec690aebb1c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:16.534945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cdf68073bc425d8a552ec690aebb1c'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:16.554436 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1436/2854] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:53:16 2022] DELETE /identity/v3/users/d1cdf68073bc425d8a552ec690aebb1c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:53:16.560172 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc904f24-f54c-4c9e-a046-b7059071fda7 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:16.560742 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc904f24-f54c-4c9e-a046-b7059071fda7 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:16.560957 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc904f24-f54c-4c9e-a046-b7059071fda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:16.580938 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-fc904f24-f54c-4c9e-a046-b7059071fda7 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:16.582080 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fc904f24-f54c-4c9e-a046-b7059071fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:16.650810 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1419/2855] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:53:16.662966 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:16.664905 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:16.694319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:16.735562 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735c61-6ce9-4c86-affd-9b5107956bbe admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:16.740675 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b77f5-fe84-4b68-96b8-439da217c62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:16.741423 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b77f5-fe84-4b68-96b8-439da217c62f service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:16.741845 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b77f5-fe84-4b68-96b8-439da217c62f service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:16.742263 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b77f5-fe84-4b68-96b8-439da217c62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:16.753607 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b77f5-fe84-4b68-96b8-439da217c62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:16.755064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b77f5-fe84-4b68-96b8-439da217c62f service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:16.765698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1437/2856] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:53:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:53:16.961555 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc904f24-f54c-4c9e-a046-b7059071fda7 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:16.963430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-fc904f24-f54c-4c9e-a046-b7059071fda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:16.981485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc904f24-f54c-4c9e-a046-b7059071fda7 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:16.989601 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:16.990754 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:16.991357 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:16.991714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] PATH_INFO: `/v3/projects/8c5722bb5e6649349d592852f0b80219` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:16.993984 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c5722bb5e6649349d592852f0b80219)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:16.998180 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:17.073073 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c5722bb5e6649349d592852f0b80219', 'request_id': 'req-8f7c5b86-6901-404a-932f-0f5dda8b4283'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:17.081740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c5722bb5e6649349d592852f0b80219', 'request_id': 'req-8f7c5b86-6901-404a-932f-0f5dda8b4283'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:17.088864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c5722bb5e6649349d592852f0b80219', 'request_id': 'req-8f7c5b86-6901-404a-932f-0f5dda8b4283'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:17.100770 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] The token cache is being invalidate because project 8c5722bb5e6649349d592852f0b80219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80435) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:53:17.102760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:17.102760 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-8f7c5b86-6901-404a-932f-0f5dda8b4283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:53:17.104367 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1420/2857] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:53:16 2022] DELETE /identity/v3/projects/8c5722bb5e6649349d592852f0b80219 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:53:17.109812 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632e351-ac63-4b3c-b82b-cf3a8fab5ae6 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.110090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632e351-ac63-4b3c-b82b-cf3a8fab5ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.110363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8632e351-ac63-4b3c-b82b-cf3a8fab5ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.131139 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-8632e351-ac63-4b3c-b82b-cf3a8fab5ae6 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:17.132445 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-8632e351-ac63-4b3c-b82b-cf3a8fab5ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:17.197656 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1438/2858] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:53:17.205896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da29a7-7134-4e3b-bc07-158cca135c09 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.206269 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da29a7-7134-4e3b-bc07-158cca135c09 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.206610 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da29a7-7134-4e3b-bc07-158cca135c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.226740 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-19da29a7-7134-4e3b-bc07-158cca135c09 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:17.227947 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-19da29a7-7134-4e3b-bc07-158cca135c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:17.246177 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1421/2859] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:53:17.250446 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632e351-ac63-4b3c-b82b-cf3a8fab5ae6 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:17.261009 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8632e351-ac63-4b3c-b82b-cf3a8fab5ae6 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:17.265673 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da50358-aafe-461d-be54-7b34059549b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:17.266281 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da50358-aafe-461d-be54-7b34059549b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.266566 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da50358-aafe-461d-be54-7b34059549b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.266839 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da50358-aafe-461d-be54-7b34059549b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.267540 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da50358-aafe-461d-be54-7b34059549b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80434) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:53:17.267883 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da50358-aafe-461d-be54-7b34059549b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:17.269488 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da50358-aafe-461d-be54-7b34059549b7 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:17.282130 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1439/2860] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:53:17.286703 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da29a7-7134-4e3b-bc07-158cca135c09 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:17.296620 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da29a7-7134-4e3b-bc07-158cca135c09 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:17.301282 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa93485-73c9-4896-9306-28a4ee9c1d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:17.301893 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa93485-73c9-4896-9306-28a4ee9c1d80 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.302195 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa93485-73c9-4896-9306-28a4ee9c1d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.302442 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa93485-73c9-4896-9306-28a4ee9c1d80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.303117 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa93485-73c9-4896-9306-28a4ee9c1d80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:17.305044 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa93485-73c9-4896-9306-28a4ee9c1d80 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:17.321151 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:17.335702 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1422/2861] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:53:17 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:53:17.340514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da50358-aafe-461d-be54-7b34059549b7 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:17.350764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da50358-aafe-461d-be54-7b34059549b7 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:17.428808 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ceeb8-9bb1-4296-bbc6-0bb29ae54b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:17.429352 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ceeb8-9bb1-4296-bbc6-0bb29ae54b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.429638 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ceeb8-9bb1-4296-bbc6-0bb29ae54b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.429911 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ceeb8-9bb1-4296-bbc6-0bb29ae54b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.430598 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ceeb8-9bb1-4296-bbc6-0bb29ae54b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:17.432770 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ceeb8-9bb1-4296-bbc6-0bb29ae54b92 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:17.457327 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1440/2862] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:53:17 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:53:17.461598 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa93485-73c9-4896-9306-28a4ee9c1d80 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:17.473732 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa93485-73c9-4896-9306-28a4ee9c1d80 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:17.480697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d55e34-15be-44ee-8e4b-4bd2165a24b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:17.481331 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d55e34-15be-44ee-8e4b-4bd2165a24b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.481726 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d55e34-15be-44ee-8e4b-4bd2165a24b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.481864 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d55e34-15be-44ee-8e4b-4bd2165a24b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.482561 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d55e34-15be-44ee-8e4b-4bd2165a24b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:17.484181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d55e34-15be-44ee-8e4b-4bd2165a24b2 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:17.495397 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1423/2863] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:53:17.499584 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ceeb8-9bb1-4296-bbc6-0bb29ae54b92 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:17.510006 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ceeb8-9bb1-4296-bbc6-0bb29ae54b92 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:17.514626 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bce36f3-2abe-4eb6-8755-bccd54fd8da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:17.515235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce36f3-2abe-4eb6-8755-bccd54fd8da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.515511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce36f3-2abe-4eb6-8755-bccd54fd8da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.515780 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bce36f3-2abe-4eb6-8755-bccd54fd8da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.516511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce36f3-2abe-4eb6-8755-bccd54fd8da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:17.518090 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bce36f3-2abe-4eb6-8755-bccd54fd8da4 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:17.530466 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1441/2864] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:53:17.535714 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d55e34-15be-44ee-8e4b-4bd2165a24b2 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:17.546379 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d55e34-15be-44ee-8e4b-4bd2165a24b2 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:17.551216 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f0af3-5e33-4f58-8b67-71e9d888c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:17.551871 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f0af3-5e33-4f58-8b67-71e9d888c675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.552158 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f0af3-5e33-4f58-8b67-71e9d888c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.552451 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f0af3-5e33-4f58-8b67-71e9d888c675 admin admin] PATH_INFO: `/v3/projects/7191ff82ccdb4ed78b592fc6f01bf9d3/users/2557b90bba5c41be864a92fc49484a3c/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.567730 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f0af3-5e33-4f58-8b67-71e9d888c675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7191ff82ccdb4ed78b592fc6f01bf9d3, user_id=2557b90bba5c41be864a92fc49484a3c, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:17.570407 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f0af3-5e33-4f58-8b67-71e9d888c675 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:17.583736 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1424/2865] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:53:17 2022] PUT /identity/v3/projects/7191ff82ccdb4ed78b592fc6f01bf9d3/users/2557b90bba5c41be864a92fc49484a3c/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:53:17.588912 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1793f3-b0d1-4d83-a62d-9cfc6a1c83c1 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.589273 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1793f3-b0d1-4d83-a62d-9cfc6a1c83c1 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.590177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1793f3-b0d1-4d83-a62d-9cfc6a1c83c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.611319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-2f1793f3-b0d1-4d83-a62d-9cfc6a1c83c1 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:17.612559 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-2f1793f3-b0d1-4d83-a62d-9cfc6a1c83c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:17.637943 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:17.675852 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1442/2866] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:53:17.686034 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f0af3-5e33-4f58-8b67-71e9d888c675 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:17.688167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-dc7f0af3-5e33-4f58-8b67-71e9d888c675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:17.748218 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f0af3-5e33-4f58-8b67-71e9d888c675 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:17.752101 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe97d6-1ebc-4a00-b27d-82a3c6f10b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:17.752748 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe97d6-1ebc-4a00-b27d-82a3c6f10b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:17.753031 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe97d6-1ebc-4a00-b27d-82a3c6f10b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:17.753310 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe97d6-1ebc-4a00-b27d-82a3c6f10b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:17.762930 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe97d6-1ebc-4a00-b27d-82a3c6f10b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:17.764401 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe97d6-1ebc-4a00-b27d-82a3c6f10b47 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:17.774214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1425/2867] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:53:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:53:18.461323 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733bbf-3dc3-41d1-9305-e7224d91b610 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:18.461895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733bbf-3dc3-41d1-9305-e7224d91b610 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:18.461895 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af733bbf-3dc3-41d1-9305-e7224d91b610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:18.502577 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-af733bbf-3dc3-41d1-9305-e7224d91b610 None None] MFA Rules not processed for user `2557b90bba5c41be864a92fc49484a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:18.504783 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-af733bbf-3dc3-41d1-9305-e7224d91b610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:18.585155 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1443/2868] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:53:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:53:18.596600 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe97d6-1ebc-4a00-b27d-82a3c6f10b47 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:18.598063 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-ddbe97d6-1ebc-4a00-b27d-82a3c6f10b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:18.666907 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe97d6-1ebc-4a00-b27d-82a3c6f10b47 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:18.671707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48b886-e0fa-449b-9423-d0febcfe6a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:18.672188 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b886-e0fa-449b-9423-d0febcfe6a22 service cinder] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:18.672565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b886-e0fa-449b-9423-d0febcfe6a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:18.672697 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a48b886-e0fa-449b-9423-d0febcfe6a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:18.681562 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48b886-e0fa-449b-9423-d0febcfe6a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:18.682983 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a48b886-e0fa-449b-9423-d0febcfe6a22 service cinder] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:18.692856 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1426/2869] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:53:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:53:20.080950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836260a-dd7b-4e09-8a83-d8c9b6b0986b None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:20.081358 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836260a-dd7b-4e09-8a83-d8c9b6b0986b None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:20.081549 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d836260a-dd7b-4e09-8a83-d8c9b6b0986b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:20.100773 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-d836260a-dd7b-4e09-8a83-d8c9b6b0986b None None] MFA Rules not processed for user `2557b90bba5c41be864a92fc49484a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:53:20.102008 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d836260a-dd7b-4e09-8a83-d8c9b6b0986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:20.109458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1444/2870] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:53:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:53:20.370504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48b886-e0fa-449b-9423-d0febcfe6a22 service cinder] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:53:20.372560 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-3a48b886-e0fa-449b-9423-d0febcfe6a22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:20.384919 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a48b886-e0fa-449b-9423-d0febcfe6a22 service cinder] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:53:20.389081 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87129984-9183-40a4-85c4-fe0f5cd886a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:53:20.389685 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87129984-9183-40a4-85c4-fe0f5cd886a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:53:20.389960 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87129984-9183-40a4-85c4-fe0f5cd886a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:53:20.390229 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87129984-9183-40a4-85c4-fe0f5cd886a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:53:20.391986 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-87129984-9183-40a4-85c4-fe0f5cd886a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:53:20.402890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87129984-9183-40a4-85c4-fe0f5cd886a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:53:20.404435 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87129984-9183-40a4-85c4-fe0f5cd886a0 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:53:20.413595 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1427/2871] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:53:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:53:30.095120 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=48 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:53:30.410368 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=2,keystone:SELECT=75 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:19.207654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836260a-dd7b-4e09-8a83-d8c9b6b0986b None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:54:19.209406 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-d836260a-dd7b-4e09-8a83-d8c9b6b0986b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:54:19.284654 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d836260a-dd7b-4e09-8a83-d8c9b6b0986b None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:54:19.289946 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617b334-a749-434e-a614-84532352ee25 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:54:19.290475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617b334-a749-434e-a614-84532352ee25 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:54:19.290757 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617b334-a749-434e-a614-84532352ee25 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:54:19.291033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617b334-a749-434e-a614-84532352ee25 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:54:19.296759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0617b334-a749-434e-a614-84532352ee25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:54:19.309513 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617b334-a749-434e-a614-84532352ee25 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:54:19.311106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617b334-a749-434e-a614-84532352ee25 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:54:19.321581 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1445/2872] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:54:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:54:29.317178 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=32 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:35.219167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cbd59-9cf9-4027-9942-e31ef56ac700 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:54:35.219951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cbd59-9cf9-4027-9942-e31ef56ac700 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:54:35.219951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8cbd59-9cf9-4027-9942-e31ef56ac700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:54:35.238858 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-4b8cbd59-9cf9-4027-9942-e31ef56ac700 None None] MFA Rules not processed for user `2557b90bba5c41be864a92fc49484a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:54:35.240091 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-4b8cbd59-9cf9-4027-9942-e31ef56ac700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:54:35.247712 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1428/2873] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:54:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:54:45.233386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:09.676862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617b334-a749-434e-a614-84532352ee25 service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:09.678328 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-0617b334-a749-434e-a614-84532352ee25 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:09.690170 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617b334-a749-434e-a614-84532352ee25 service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:09.693804 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee4601-b663-4e2c-98b1-b33b04730c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '124c246d00a841608a2bc4f5230f4eaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:09.694408 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee4601-b663-4e2c-98b1-b33b04730c99 service cinder] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:09.694691 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee4601-b663-4e2c-98b1-b33b04730c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:09.694970 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee4601-b663-4e2c-98b1-b33b04730c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:09.696714 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-11ee4601-b663-4e2c-98b1-b33b04730c99 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:09.766250 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee4601-b663-4e2c-98b1-b33b04730c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:09.767684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee4601-b663-4e2c-98b1-b33b04730c99 service cinder] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:09.779209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1446/2874] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:55:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:55:12.398410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cbd59-9cf9-4027-9942-e31ef56ac700 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:12.408883 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8cbd59-9cf9-4027-9942-e31ef56ac700 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:12.412360 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250501d-bcfc-4272-95a2-1adb995694ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:12.412961 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250501d-bcfc-4272-95a2-1adb995694ca service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:12.413235 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250501d-bcfc-4272-95a2-1adb995694ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:12.413501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250501d-bcfc-4272-95a2-1adb995694ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:12.415212 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6250501d-bcfc-4272-95a2-1adb995694ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:12.428768 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250501d-bcfc-4272-95a2-1adb995694ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:12.430176 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250501d-bcfc-4272-95a2-1adb995694ca service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:12.440988 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1429/2875] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:55:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:55:19.773945 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=34 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:22.436524 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=6 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:39.675826 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee4601-b663-4e2c-98b1-b33b04730c99 service cinder] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:39.691835 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee4601-b663-4e2c-98b1-b33b04730c99 service cinder] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:39.700370 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd61608-05ae-42b5-9ed5-3fd830031b46 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:39.701241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd61608-05ae-42b5-9ed5-3fd830031b46 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:39.701680 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd61608-05ae-42b5-9ed5-3fd830031b46 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:39.701965 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd61608-05ae-42b5-9ed5-3fd830031b46 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:39.704647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-7cd61608-05ae-42b5-9ed5-3fd830031b46 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:39.723385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd61608-05ae-42b5-9ed5-3fd830031b46 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:39.725603 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd61608-05ae-42b5-9ed5-3fd830031b46 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:39.741591 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1447/2876] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:55:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:55:39.749386 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250501d-bcfc-4272-95a2-1adb995694ca service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:39.761973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250501d-bcfc-4272-95a2-1adb995694ca service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:39.767247 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:39.768504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:39.768504 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:39.768686 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] PATH_INFO: `/v3/users/2557b90bba5c41be864a92fc49484a3c` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:39.769936 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2557b90bba5c41be864a92fc49484a3c)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:39.772499 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:39.825165 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2557b90bba5c41be864a92fc49484a3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:39.832445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2557b90bba5c41be864a92fc49484a3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:39.839992 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2557b90bba5c41be864a92fc49484a3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:39.840643 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2557b90bba5c41be864a92fc49484a3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:39.841237 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-88c02abf-95ba-441b-98d8-3c8df8eb8205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2557b90bba5c41be864a92fc49484a3c'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:39.859205 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1430/2877] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:55:39 2022] DELETE /identity/v3/users/2557b90bba5c41be864a92fc49484a3c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:55:40.041565 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd61608-05ae-42b5-9ed5-3fd830031b46 service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:40.056715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd61608-05ae-42b5-9ed5-3fd830031b46 service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:40.122060 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:40.122742 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.123018 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.123385 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] PATH_INFO: `/v3/projects/7191ff82ccdb4ed78b592fc6f01bf9d3` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.124890 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7191ff82ccdb4ed78b592fc6f01bf9d3)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:40.126994 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:40.182456 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'request_id': 'req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:40.192217 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'request_id': 'req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:40.202987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7191ff82ccdb4ed78b592fc6f01bf9d3', 'request_id': 'req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:40.215840 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] The token cache is being invalidate because project 7191ff82ccdb4ed78b592fc6f01bf9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:55:40.216067 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:40.216734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-f9bf5e06-b7ab-43ad-b0ba-20f5237f9262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:55:40.218304 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1448/2878] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:55:40 2022] DELETE /identity/v3/projects/7191ff82ccdb4ed78b592fc6f01bf9d3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:55:40.223669 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9bf13-42e4-484f-9494-942ebabae4b2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.224156 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9bf13-42e4-484f-9494-942ebabae4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.224501 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9bf13-42e4-484f-9494-942ebabae4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.247557 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6cf9bf13-42e4-484f-9494-942ebabae4b2 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:55:40.248886 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6cf9bf13-42e4-484f-9494-942ebabae4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:40.314183 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1431/2879] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:55:40.322108 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cff860-5cef-419a-a0dd-0362f70208f9 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.322399 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cff860-5cef-419a-a0dd-0362f70208f9 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.322684 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cff860-5cef-419a-a0dd-0362f70208f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.343935 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-21cff860-5cef-419a-a0dd-0362f70208f9 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:55:40.345203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-21cff860-5cef-419a-a0dd-0362f70208f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:40.354083 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1449/2880] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:55:40.358363 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9bf13-42e4-484f-9494-942ebabae4b2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:40.368307 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9bf13-42e4-484f-9494-942ebabae4b2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:40.372971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d9b9a-dc16-499d-8ea6-d1f9b3beb90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:40.373607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9b9a-dc16-499d-8ea6-d1f9b3beb90f admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.373896 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9b9a-dc16-499d-8ea6-d1f9b3beb90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.374167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9b9a-dc16-499d-8ea6-d1f9b3beb90f admin admin] PATH_INFO: `/v3/domains` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.374882 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d9b9a-dc16-499d-8ea6-d1f9b3beb90f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80435) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:55:40.375182 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d9b9a-dc16-499d-8ea6-d1f9b3beb90f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:40.376897 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d9b9a-dc16-499d-8ea6-d1f9b3beb90f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:40.389040 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1432/2881] 10.222.0.57 () {58 vars in 1153 bytes} [Tue Aug 2 21:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:55:40.393647 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cff860-5cef-419a-a0dd-0362f70208f9 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:40.404433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cff860-5cef-419a-a0dd-0362f70208f9 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:40.410597 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a022c-370c-4eeb-b998-9d93565b879c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:40.411227 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a022c-370c-4eeb-b998-9d93565b879c admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.411508 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a022c-370c-4eeb-b998-9d93565b879c admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.411781 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a022c-370c-4eeb-b998-9d93565b879c admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.412511 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a022c-370c-4eeb-b998-9d93565b879c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:40.414497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a022c-370c-4eeb-b998-9d93565b879c admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:40.451661 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1450/2882] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:55:40 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:55:40.456547 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d9b9a-dc16-499d-8ea6-d1f9b3beb90f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:40.467711 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d9b9a-dc16-499d-8ea6-d1f9b3beb90f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:40.525792 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0ce3f-886e-46bc-8524-7fcb4ba274c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:40.526410 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0ce3f-886e-46bc-8524-7fcb4ba274c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.526694 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0ce3f-886e-46bc-8524-7fcb4ba274c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.526970 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0ce3f-886e-46bc-8524-7fcb4ba274c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.527927 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0ce3f-886e-46bc-8524-7fcb4ba274c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:40.529902 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0ce3f-886e-46bc-8524-7fcb4ba274c9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:40.537953 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:40.556552 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1433/2883] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:55:40 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:55:40.558066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a022c-370c-4eeb-b998-9d93565b879c admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:40.568450 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a022c-370c-4eeb-b998-9d93565b879c admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:40.573121 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046eae9-4c75-4fba-a53a-bbcd6919ac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:40.573738 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046eae9-4c75-4fba-a53a-bbcd6919ac91 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.574022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046eae9-4c75-4fba-a53a-bbcd6919ac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.574291 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046eae9-4c75-4fba-a53a-bbcd6919ac91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.574995 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046eae9-4c75-4fba-a53a-bbcd6919ac91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:40.576627 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046eae9-4c75-4fba-a53a-bbcd6919ac91 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:40.586646 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1451/2884] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:55:40.591199 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0ce3f-886e-46bc-8524-7fcb4ba274c9 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:40.601605 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0ce3f-886e-46bc-8524-7fcb4ba274c9 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:40.606987 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3354306-1e08-499a-8d53-650b5e55a1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:40.607607 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354306-1e08-499a-8d53-650b5e55a1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.607890 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354306-1e08-499a-8d53-650b5e55a1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.608187 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3354306-1e08-499a-8d53-650b5e55a1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.608900 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354306-1e08-499a-8d53-650b5e55a1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:40.610522 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3354306-1e08-499a-8d53-650b5e55a1b9 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:40.624006 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1434/2885] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:55:40.628433 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046eae9-4c75-4fba-a53a-bbcd6919ac91 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:40.639704 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046eae9-4c75-4fba-a53a-bbcd6919ac91 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:40.644405 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2110523-bfed-422f-bf6e-34c243d4519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:40.645073 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2110523-bfed-422f-bf6e-34c243d4519f admin admin] REQUEST_METHOD: `PUT` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.645357 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2110523-bfed-422f-bf6e-34c243d4519f admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.645635 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2110523-bfed-422f-bf6e-34c243d4519f admin admin] PATH_INFO: `/v3/projects/22deaa4824874516b11d615beab8392e/users/52420cdbbfed4bfd97c6e5010cb21e07/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.661063 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2110523-bfed-422f-bf6e-34c243d4519f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22deaa4824874516b11d615beab8392e, user_id=52420cdbbfed4bfd97c6e5010cb21e07, role_id=1b0cbdbdb5184dbdacfaf718c35ab7ee)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:40.663723 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2110523-bfed-422f-bf6e-34c243d4519f admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:40.678235 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1452/2886] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:55:40 2022] PUT /identity/v3/projects/22deaa4824874516b11d615beab8392e/users/52420cdbbfed4bfd97c6e5010cb21e07/roles/1b0cbdbdb5184dbdacfaf718c35ab7ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:55:40.683337 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058389a5-8aa4-453d-9b26-4910d0210d01 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.683650 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058389a5-8aa4-453d-9b26-4910d0210d01 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.683951 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058389a5-8aa4-453d-9b26-4910d0210d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.703394 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-058389a5-8aa4-453d-9b26-4910d0210d01 None None] MFA Rules not processed for user `26d170ed749e495e8c4adc26cb1aaae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:55:40.704636 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-058389a5-8aa4-453d-9b26-4910d0210d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:40.762498 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1435/2887] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:55:40.772359 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2110523-bfed-422f-bf6e-34c243d4519f admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:40.774066 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-f2110523-bfed-422f-bf6e-34c243d4519f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:40.789322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:40.838022 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2110523-bfed-422f-bf6e-34c243d4519f admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:40.841792 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2251b-25fb-4e1c-a5ec-7b430e38a7aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:40.842417 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2251b-25fb-4e1c-a5ec-7b430e38a7aa service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:40.842698 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2251b-25fb-4e1c-a5ec-7b430e38a7aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:40.842987 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb2251b-25fb-4e1c-a5ec-7b430e38a7aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:40.852759 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2251b-25fb-4e1c-a5ec-7b430e38a7aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:40.854211 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb2251b-25fb-4e1c-a5ec-7b430e38a7aa service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:40.865530 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1453/2888] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:55:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:55:45.282343 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f167d7-8937-4b14-87ef-4e2024e347f2 None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:45.282923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f167d7-8937-4b14-87ef-4e2024e347f2 None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:45.282923 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f167d7-8937-4b14-87ef-4e2024e347f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:45.314629 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-07f167d7-8937-4b14-87ef-4e2024e347f2 None None] MFA Rules not processed for user `52420cdbbfed4bfd97c6e5010cb21e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:55:45.316223 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-07f167d7-8937-4b14-87ef-4e2024e347f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:45.386709 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1436/2889] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:55:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:55:45.391351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2251b-25fb-4e1c-a5ec-7b430e38a7aa service neutron] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:45.401889 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb2251b-25fb-4e1c-a5ec-7b430e38a7aa service neutron] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:45.407500 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffdc92-69e5-4b6c-8013-03c242f80923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:45.408113 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffdc92-69e5-4b6c-8013-03c242f80923 admin admin] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:45.408426 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffdc92-69e5-4b6c-8013-03c242f80923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:45.408694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffdc92-69e5-4b6c-8013-03c242f80923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:45.409348 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffdc92-69e5-4b6c-8013-03c242f80923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:45.411230 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffdc92-69e5-4b6c-8013-03c242f80923 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:45.437475 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1454/2890] 10.222.0.57 () {60 vars in 1153 bytes} [Tue Aug 2 21:55:45 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:55:45.441575 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f167d7-8937-4b14-87ef-4e2024e347f2 None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:45.452973 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f167d7-8937-4b14-87ef-4e2024e347f2 None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:45.515441 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eba4b-81d4-46e4-ae82-a891fdf62eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:45.515999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eba4b-81d4-46e4-ae82-a891fdf62eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:45.516336 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eba4b-81d4-46e4-ae82-a891fdf62eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:45.516690 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eba4b-81d4-46e4-ae82-a891fdf62eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:45.517365 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eba4b-81d4-46e4-ae82-a891fdf62eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:45.519295 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eba4b-81d4-46e4-ae82-a891fdf62eb0 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:45.536482 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:45.543135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1437/2891] 10.222.0.57 () {60 vars in 1144 bytes} [Tue Aug 2 21:55:45 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:55:45.546833 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffdc92-69e5-4b6c-8013-03c242f80923 admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:45.558210 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffdc92-69e5-4b6c-8013-03c242f80923 admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:45.564078 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545b608-cb9f-4213-a90d-7e292fde14cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:45.564715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545b608-cb9f-4213-a90d-7e292fde14cf admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:45.564993 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545b608-cb9f-4213-a90d-7e292fde14cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:45.565261 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545b608-cb9f-4213-a90d-7e292fde14cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:45.565959 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545b608-cb9f-4213-a90d-7e292fde14cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:45.567559 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545b608-cb9f-4213-a90d-7e292fde14cf admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:45.579571 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1455/2892] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:55:45.583966 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eba4b-81d4-46e4-ae82-a891fdf62eb0 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:45.594594 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eba4b-81d4-46e4-ae82-a891fdf62eb0 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:45.599833 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0674c9-6331-4724-bde6-ee5eaacc1d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:45.600651 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0674c9-6331-4724-bde6-ee5eaacc1d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:45.600939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0674c9-6331-4724-bde6-ee5eaacc1d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:45.601274 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0674c9-6331-4724-bde6-ee5eaacc1d68 admin admin] PATH_INFO: `/v3/projects/044408834c8a4b758be3a001e24db7be/users/8cbe74f5b82941058b02c3679f4d42e6/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:45.616181 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0674c9-6331-4724-bde6-ee5eaacc1d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044408834c8a4b758be3a001e24db7be, user_id=8cbe74f5b82941058b02c3679f4d42e6, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:45.619344 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0674c9-6331-4724-bde6-ee5eaacc1d68 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:45.632456 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1438/2893] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:55:45 2022] PUT /identity/v3/projects/044408834c8a4b758be3a001e24db7be/users/8cbe74f5b82941058b02c3679f4d42e6/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:55:45.637158 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545b608-cb9f-4213-a90d-7e292fde14cf admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:45.649743 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545b608-cb9f-4213-a90d-7e292fde14cf admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:45.709331 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63db86-a2fc-4e95-945b-3560cbae61f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:45.709956 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63db86-a2fc-4e95-945b-3560cbae61f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:45.710241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63db86-a2fc-4e95-945b-3560cbae61f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:45.710514 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63db86-a2fc-4e95-945b-3560cbae61f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:45.711207 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63db86-a2fc-4e95-945b-3560cbae61f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:45.712844 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63db86-a2fc-4e95-945b-3560cbae61f3 admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:45.722421 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1456/2894] 10.222.0.57 () {58 vars in 1122 bytes} [Tue Aug 2 21:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:55:45.726801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0674c9-6331-4724-bde6-ee5eaacc1d68 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:45.737264 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0674c9-6331-4724-bde6-ee5eaacc1d68 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:45.742131 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc7a4f-4d9b-42ce-a92b-415133f6f7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:45.742812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc7a4f-4d9b-42ce-a92b-415133f6f7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:45.743587 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc7a4f-4d9b-42ce-a92b-415133f6f7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:45.743860 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc7a4f-4d9b-42ce-a92b-415133f6f7e5 admin admin] PATH_INFO: `/v3/projects/044408834c8a4b758be3a001e24db7be/users/8cbe74f5b82941058b02c3679f4d42e6/roles/ecc5b2701c504f1a96322b36e39b231a` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:45.745910 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc7a4f-4d9b-42ce-a92b-415133f6f7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044408834c8a4b758be3a001e24db7be, user_id=8cbe74f5b82941058b02c3679f4d42e6, role_id=ecc5b2701c504f1a96322b36e39b231a)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:45.748589 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc7a4f-4d9b-42ce-a92b-415133f6f7e5 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:45.760313 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1439/2895] 10.222.0.57 () {60 vars in 1483 bytes} [Tue Aug 2 21:55:45 2022] PUT /identity/v3/projects/044408834c8a4b758be3a001e24db7be/users/8cbe74f5b82941058b02c3679f4d42e6/roles/ecc5b2701c504f1a96322b36e39b231a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:55:50.005173 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adff4a9-cfb7-4795-889e-e7c58f007d71 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:50.005734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adff4a9-cfb7-4795-889e-e7c58f007d71 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:50.005734 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adff4a9-cfb7-4795-889e-e7c58f007d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:50.047645 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-1adff4a9-cfb7-4795-889e-e7c58f007d71 None None] MFA Rules not processed for user `8cbe74f5b82941058b02c3679f4d42e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:55:50.049133 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-1adff4a9-cfb7-4795-889e-e7c58f007d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:50.140231 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1457/2896] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:55:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:55:50.154512 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc7a4f-4d9b-42ce-a92b-415133f6f7e5 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:50.156419 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-68cc7a4f-4d9b-42ce-a92b-415133f6f7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:50.244213 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc7a4f-4d9b-42ce-a92b-415133f6f7e5 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:50.247867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4950030-7677-4935-9608-c441db500252 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e3cd62eb975492aab4a136c0e9825a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:50.248825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950030-7677-4935-9608-c441db500252 service glance] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:50.248825 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950030-7677-4935-9608-c441db500252 service glance] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:50.249056 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4950030-7677-4935-9608-c441db500252 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:50.327956 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4950030-7677-4935-9608-c441db500252 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:50.329867 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4950030-7677-4935-9608-c441db500252 service glance] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:50.340769 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1440/2897] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:55:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:55:50.475880 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbbb58-8750-4c83-9ba0-1d8afc3b5a27 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:50.476203 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbbb58-8750-4c83-9ba0-1d8afc3b5a27 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:50.476483 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbbb58-8750-4c83-9ba0-1d8afc3b5a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:50.486830 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:50.500873 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-06cbbb58-8750-4c83-9ba0-1d8afc3b5a27 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:55:50.502176 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-06cbbb58-8750-4c83-9ba0-1d8afc3b5a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:50.569208 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1458/2898] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:55:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:55:50.621746 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4950030-7677-4935-9608-c441db500252 service glance] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:55:50.623330 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-c4950030-7677-4935-9608-c441db500252 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:50.685551 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:55:50.702566 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4950030-7677-4935-9608-c441db500252 service glance] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:55:50.711939 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c1a3a-606f-4969-b0f5-db307dcfe6b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:55:50.712654 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1a3a-606f-4969-b0f5-db307dcfe6b9 service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:50.712941 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1a3a-606f-4969-b0f5-db307dcfe6b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:50.713217 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c1a3a-606f-4969-b0f5-db307dcfe6b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:50.724408 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c1a3a-606f-4969-b0f5-db307dcfe6b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:55:50.726166 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c1a3a-606f-4969-b0f5-db307dcfe6b9 service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:55:50.735075 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1441/2899] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:55:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:55:59.157620 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52bd87-87ce-4577-8c3a-226543c05a94 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:55:59.158141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52bd87-87ce-4577-8c3a-226543c05a94 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:55:59.158253 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52bd87-87ce-4577-8c3a-226543c05a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:55:59.177188 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-ec52bd87-87ce-4577-8c3a-226543c05a94 None None] MFA Rules not processed for user `52420cdbbfed4bfd97c6e5010cb21e07`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:55:59.178447 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-ec52bd87-87ce-4577-8c3a-226543c05a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:55:59.186193 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1459/2900] 10.222.0.57 () {58 vars in 958 bytes} [Tue Aug 2 21:55:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:56:00.731637 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=7 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:01.005922 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561cb9e-df00-4169-bed4-ffa5dacf466d None None] REQUEST_METHOD: `POST` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:56:01.006214 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561cb9e-df00-4169-bed4-ffa5dacf466d None None] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:56:01.006492 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561cb9e-df00-4169-bed4-ffa5dacf466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:56:01.025894 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.auth.core [None req-6561cb9e-df00-4169-bed4-ffa5dacf466d None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80435) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:56:01.027119 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-6561cb9e-df00-4169-bed4-ffa5dacf466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:56:01.034660 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1442/2901] 10.222.0.57 () {58 vars in 1009 bytes} [Tue Aug 2 21:56:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:56:01.048458 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52bd87-87ce-4577-8c3a-226543c05a94 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:56:01.061179 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52bd87-87ce-4577-8c3a-226543c05a94 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:56:01.066212 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0002a8-0581-4673-9851-023a4d542dd2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:56:01.066914 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0002a8-0581-4673-9851-023a4d542dd2 service swift] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:56:01.067322 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0002a8-0581-4673-9851-023a4d542dd2 service swift] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:56:01.067669 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0002a8-0581-4673-9851-023a4d542dd2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:56:01.076378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0002a8-0581-4673-9851-023a4d542dd2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:56:01.078064 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0002a8-0581-4673-9851-023a4d542dd2 service swift] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:56:01.086810 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1460/2902] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:56:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:56:11.020448 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=3 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:11.083117 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=32 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:11.812899 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561cb9e-df00-4169-bed4-ffa5dacf466d None None] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:56:11.867485 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6561cb9e-df00-4169-bed4-ffa5dacf466d None None] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:56:11.870727 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:56:11.871332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:56:11.871608 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:56:11.871876 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:56:11.873661 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:56:11.883042 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:56:11.884493 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:56:11.892240 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1443/2903] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:56:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:56:21.888783 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=26 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:56:31.587497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0002a8-0581-4673-9851-023a4d542dd2 service swift] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:56:31.597560 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0002a8-0581-4673-9851-023a4d542dd2 service swift] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:56:31.601152 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0d23e-b8fd-4b65-8ebc-8105c29d78b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24644cede7e149a6b3e5bd39b930017b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:56:31.601764 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d23e-b8fd-4b65-8ebc-8105c29d78b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:56:31.602046 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d23e-b8fd-4b65-8ebc-8105c29d78b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:56:31.602351 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d23e-b8fd-4b65-8ebc-8105c29d78b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:56:31.611794 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0d23e-b8fd-4b65-8ebc-8105c29d78b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:56:31.613471 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0d23e-b8fd-4b65-8ebc-8105c29d78b0 service neutron] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:56:31.624501 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1461/2904] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:56:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:56:41.619862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=6 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:58:34.806869 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:58:34.808474 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:58:34.960015 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1efe-c4eb-4870-a5e9-dc366af2a476 service neutron] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:58:34.967812 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7446f-2434-48a2-8109-7058d0523b50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cab044fcd0dd449eafaccb81606d15ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:58:34.968565 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7446f-2434-48a2-8109-7058d0523b50 service nova] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:58:34.968822 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7446f-2434-48a2-8109-7058d0523b50 service nova] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:58:34.969097 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7446f-2434-48a2-8109-7058d0523b50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:58:34.970999 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-32f7446f-2434-48a2-8109-7058d0523b50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:58:34.987843 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7446f-2434-48a2-8109-7058d0523b50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:58:34.989861 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f7446f-2434-48a2-8109-7058d0523b50 service nova] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:58:35.008949 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1444/2905] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:58:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:58:42.141071 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d981b10-d133-436c-9ed1-40977bf107b8 None None] REQUEST_METHOD: `POST` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:58:42.141557 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d981b10-d133-436c-9ed1-40977bf107b8 None None] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:58:42.141683 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d981b10-d133-436c-9ed1-40977bf107b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:58:42.160461 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.auth.core [None req-4d981b10-d133-436c-9ed1-40977bf107b8 None None] MFA Rules not processed for user `31a94e98e1b2499f8417dd10d00e780e`. Rule list: `[]` (Enabled: `True`). {{(pid=80434) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:58:42.162186 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4d981b10-d133-436c-9ed1-40977bf107b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:58:42.169378 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1462/2906] 10.222.0.57 () {58 vars in 967 bytes} [Tue Aug 2 21:58:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:58:42.211416 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7446f-2434-48a2-8109-7058d0523b50 service nova] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:58:42.222779 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7446f-2434-48a2-8109-7058d0523b50 service nova] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:58:42.228312 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9dd19-94a6-440a-bb8c-48ec5923d66a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa5d7ef1e1cd4185b3f0eb8215bf0dd6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:58:42.228915 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9dd19-94a6-440a-bb8c-48ec5923d66a service swift] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:58:42.229193 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9dd19-94a6-440a-bb8c-48ec5923d66a service swift] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:58:42.229461 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9dd19-94a6-440a-bb8c-48ec5923d66a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:58:42.237580 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9dd19-94a6-440a-bb8c-48ec5923d66a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:58:42.239135 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9dd19-94a6-440a-bb8c-48ec5923d66a service swift] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:58:42.247382 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1445/2907] 10.222.0.57 () {60 vars in 1384 bytes} [Tue Aug 2 21:58:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:58:45.431335 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d981b10-d133-436c-9ed1-40977bf107b8 None None] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:58:45.432969 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-4d981b10-d133-436c-9ed1-40977bf107b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:58:45.518454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d981b10-d133-436c-9ed1-40977bf107b8 None None] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:58:45.523694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f82f5-ecee-47e5-aa01-f990c6b67684 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:58:45.524464 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f82f5-ecee-47e5-aa01-f990c6b67684 service placement] REQUEST_METHOD: `GET` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:58:45.524825 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f82f5-ecee-47e5-aa01-f990c6b67684 service placement] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:58:45.525177 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f82f5-ecee-47e5-aa01-f990c6b67684 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:58:45.527181 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-b82f82f5-ecee-47e5-aa01-f990c6b67684 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:58:45.541076 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f82f5-ecee-47e5-aa01-f990c6b67684 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:58:45.542864 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f82f5-ecee-47e5-aa01-f990c6b67684 service placement] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:58:45.555141 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1463/2908] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:58:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:58:48.665863 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9dd19-94a6-440a-bb8c-48ec5923d66a service swift] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:58:48.753434 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9dd19-94a6-440a-bb8c-48ec5923d66a service swift] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:58:48.758036 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:58:48.758672 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:58:48.758959 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:58:48.759395 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] PATH_INFO: `/v3/users/52420cdbbfed4bfd97c6e5010cb21e07` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:58:48.760734 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52420cdbbfed4bfd97c6e5010cb21e07)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:58:48.762646 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:58:48.768167 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=100 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:58:48.815234 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52420cdbbfed4bfd97c6e5010cb21e07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:48.822161 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52420cdbbfed4bfd97c6e5010cb21e07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:48.831842 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52420cdbbfed4bfd97c6e5010cb21e07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:48.832430 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52420cdbbfed4bfd97c6e5010cb21e07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:48.833030 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52420cdbbfed4bfd97c6e5010cb21e07'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:48.850691 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1446/2909] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:58:48 2022] DELETE /identity/v3/users/52420cdbbfed4bfd97c6e5010cb21e07 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:58:49.022558 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f82f5-ecee-47e5-aa01-f990c6b67684 service placement] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:58:49.033636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f82f5-ecee-47e5-aa01-f990c6b67684 service placement] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:58:49.095012 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:58:49.095653 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:58:49.095935 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:58:49.096241 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] PATH_INFO: `/v3/projects/22deaa4824874516b11d615beab8392e` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:58:49.097381 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22deaa4824874516b11d615beab8392e)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:58:49.099862 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:58:49.146585 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22deaa4824874516b11d615beab8392e', 'request_id': 'req-09823770-5bde-4f88-8bd1-9b2e786afc8e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.152636 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22deaa4824874516b11d615beab8392e', 'request_id': 'req-09823770-5bde-4f88-8bd1-9b2e786afc8e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.160964 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22deaa4824874516b11d615beab8392e', 'request_id': 'req-09823770-5bde-4f88-8bd1-9b2e786afc8e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.186497 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] The token cache is being invalidate because project 22deaa4824874516b11d615beab8392e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:58:49.186785 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.187411 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.188944 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1464/2910] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:58:49 2022] DELETE /identity/v3/projects/22deaa4824874516b11d615beab8392e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:58:49.193150 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:58:49.194626 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:58:49.207445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3b8d8-7a1c-4bbe-9211-1135486ac5b3 admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:58:49.263013 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:58:49.263655 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:58:49.263935 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:58:49.264245 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] PATH_INFO: `/v3/users/8cbe74f5b82941058b02c3679f4d42e6` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:58:49.265415 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbe74f5b82941058b02c3679f4d42e6)` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:58:49.267332 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:58:49.325905 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbe74f5b82941058b02c3679f4d42e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.334142 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbe74f5b82941058b02c3679f4d42e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.341971 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbe74f5b82941058b02c3679f4d42e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.342707 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbe74f5b82941058b02c3679f4d42e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.343318 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.notifications [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbe74f5b82941058b02c3679f4d42e6'} {{(pid=80435) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.360273 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1447/2911] 10.222.0.57 () {58 vars in 1224 bytes} [Tue Aug 2 21:58:49 2022] DELETE /identity/v3/users/8cbe74f5b82941058b02c3679f4d42e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:58:49.536209 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] Authenticating user token {{(pid=80434) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:58:49.537715 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.fernet_utils [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80434) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:58:49.545430 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:58:49.557694 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09823770-5bde-4f88-8bd1-9b2e786afc8e admin admin] Validating token access rules against request {{(pid=80434) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:58:49.616074 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26d170ed749e495e8c4adc26cb1aaae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a739ee2f7d746e0a37b1f7b651a505d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80434) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:58:49.616772 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:58:49.617033 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:58:49.617303 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] PATH_INFO: `/v3/projects/044408834c8a4b758be3a001e24db7be` {{(pid=80434) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:58:49.618454 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=044408834c8a4b758be3a001e24db7be)` {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:58:49.620841 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] RBAC: Authorization granted {{(pid=80434) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:58:49.678998 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044408834c8a4b758be3a001e24db7be', 'request_id': 'req-6c383e9d-90e4-4718-b056-80d72955dd0e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.686950 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044408834c8a4b758be3a001e24db7be', 'request_id': 'req-6c383e9d-90e4-4718-b056-80d72955dd0e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.697319 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044408834c8a4b758be3a001e24db7be', 'request_id': 'req-6c383e9d-90e4-4718-b056-80d72955dd0e'} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.711822 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] The token cache is being invalidate because project 044408834c8a4b758be3a001e24db7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80434) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:58:49.712106 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.712869 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG keystone.notifications [None req-6c383e9d-90e4-4718-b056-80d72955dd0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80434) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:58:49.714363 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: [pid: 80434|app: 0|req: 1465/2912] 10.222.0.57 () {58 vars in 1233 bytes} [Tue Aug 2 21:58:49 2022] DELETE /identity/v3/projects/044408834c8a4b758be3a001e24db7be => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:58:59.356801 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=76,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:58:59.708566 dv-cinder-851449-4-iscsi devstack@keystone.service[80434]: DEBUG dbcounter [-] [80434] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80434) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:59:25.156186 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] Authenticating user token {{(pid=80435) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:59:25.157581 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:59:25.249747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3734e9e-3c1c-4e01-9ef9-31135b0a706f admin admin] Validating token access rules against request {{(pid=80435) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:59:25.308708 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ca995-a95f-47ce-b7fc-03011a478a5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad52cba0b761482d96b6659654034ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '21fa5a0ae53c48b2a468a2de5aec5148', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80435) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:59:25.309327 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ca995-a95f-47ce-b7fc-03011a478a5a service placement] REQUEST_METHOD: `GET` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:59:25.309609 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ca995-a95f-47ce-b7fc-03011a478a5a service placement] SCRIPT_NAME: `/identity` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:59:25.309881 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ca995-a95f-47ce-b7fc-03011a478a5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80435) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:59:25.311747 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.fernet_utils [None req-678ca995-a95f-47ce-b7fc-03011a478a5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80435) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:59:25.323689 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ca995-a95f-47ce-b7fc-03011a478a5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:59:25.325291 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ca995-a95f-47ce-b7fc-03011a478a5a service placement] RBAC: Authorization granted {{(pid=80435) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:59:25.336445 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: [pid: 80435|app: 0|req: 1448/2913] 10.222.0.57 () {60 vars in 1365 bytes} [Tue Aug 2 21:59:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:59:35.331232 dv-cinder-851449-4-iscsi devstack@keystone.service[80435]: DEBUG dbcounter [-] [80435] Writing DB stats keystone:SELECT=67 {{(pid=80435) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}